Topology identification of sparse network: A stochastic variational Bayesian approach

被引:1
作者
Liu, Qie [1 ]
Huang, Biao [2 ]
Chai, Yi [1 ]
Li, Wenbo [3 ]
机构
[1] Chongqing Univ, Sch Automat, Chongqing, Peoples R China
[2] Univ Alberta, Dept Chem & Mat Engn, Edmonton, AB, Canada
[3] Beijing Inst Control Engn, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Topology identification; Sparse networks; Stochastic optimization; Bayesian learning; SYSTEM-IDENTIFICATION; DYNAMIC NETWORKS; MODULES;
D O I
10.1016/j.automatica.2023.111173
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The topology identification of sparse networks is crucial for network modeling in many fields. The variational Bayesian inference has been proved to be effective for solving this issue. However, since all the observed data are used to compute the posterior distributions of the global variables at each iteration of the classical variational inference, the computation complexity is too high to be suitable for large data sets, especially for large-scale networks, where more data is needed for the inference. In this paper, we derive an efficient algorithm to maximize a lower bound function in the Bayesian inference based on stochastic optimization, where only a part of data is used at each iteration. Compared with the traditional variational Bayesian inference approach, the proposed method can significantly decrease the computation so that it is more suitable for the network identification with large data sets. Several typical sparse networks are used to test the performance of the proposed method, and the results demonstrate its merits.& COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:8
相关论文
共 26 条
[1]   Natural gradient works efficiently in learning [J].
Amari, S .
NEURAL COMPUTATION, 1998, 10 (02) :251-276
[2]  
Bar-Gera H., 1999, Origin-based algorithms for transportation network modeling
[3]   Variational Bayesian approach for ARX systems with missing observations and varying time-delays [J].
Chen, Jing ;
Huang, Biao ;
Ding, Feng ;
Gu, Ya .
AUTOMATICA, 2018, 94 :194-204
[4]  
Chen T, 1999, Pac Symp Biocomput, P29
[6]   A Bayesian approach to sparse dynamic network identification [J].
Chiuso, Alessandro ;
Pillonetto, Gianluigi .
AUTOMATICA, 2012, 48 (08) :1553-1565
[7]  
Dankers A, 2015, IEEE DECIS CONTR P, P3487, DOI 10.1109/CDC.2015.7402759
[8]   An empirical Bayes approach to identification of modules in dynamic networks [J].
Everitt, Niklas ;
Bottegal, Giulio ;
Hjalmarsson, Hakan .
AUTOMATICA, 2018, 91 :144-151
[9]   On the identifiability of dynamical networks [J].
Gevers, Michel ;
Bazanella, Alexandre S. ;
Parraga, Adriane .
IFAC PAPERSONLINE, 2017, 50 (01) :10580-10585
[10]  
Ghahramani Z, 2001, ADV NEUR IN, V13, P507