Graph learning from incomplete graph signals: From batch to online methods

被引:1
作者
Zhang, Xiang [1 ]
Wang, Qiao [1 ,2 ]
机构
[1] Southeast Univ, Sch Informat Sci & Engn, Nanjing 210096, Peoples R China
[2] Southeast Univ, Sch Econ & Management, Nanjing 210096, Peoples R China
关键词
Graph learning; Incomplete data; Graph signal recovery; Graph signal processing; Online learning; INFERENCE;
D O I
10.1016/j.sigpro.2024.109663
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Inferring graph topologies from data is crucial in many graph-related applications. Existing works typically assume that signals are observed at all nodes, which may not hold due to application-specific constraints. The problem becomes more challenging when data are sequentially available and no delay is tolerated. To address these issues, we propose an approach for learning graphs from incomplete data. First, the problem of learning graphs with missing data is formulated as maximizing the posterior distribution with hidden variables from a Bayesian perspective. Then, we propose an expectation maximization (EM) algorithm to solve the induced problem, in which graph learning and graph signal recovery are jointly performed. Furthermore, we extend the proposed EM algorithm to an online version to accommodate the delay-sensitive situations of sequential data. Theoretically, we analyze the dynamic regret of the proposed online algorithm, illustrating the effectiveness of our algorithm in tracking graphs from partial observations in an online manner. Finally, extensive experiments on synthetic and real data are conducted, and the results corroborate that our approach can learn graphs effectively from incomplete data in both batch and online situations.
引用
收藏
页数:12
相关论文
共 47 条
[1]   Techniques for dealing with incomplete data: a tutorial and survey [J].
Aste, Marco ;
Boninsegna, Massimo ;
Freno, Antonino ;
Trentin, Edmondo .
PATTERN ANALYSIS AND APPLICATIONS, 2015, 18 (01) :1-29
[2]   Efficient Graph Learning From Noisy and Incomplete Data [J].
Berger, Peter ;
Hannak, Gabor ;
Matz, Gerald .
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2020, 6 :105-119
[3]   Graph Signal Recovery via Primal-Dual Algorithms for Total Variation Minimization [J].
Berger, Peter ;
Hannak, Gabor ;
Matz, Gerald .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (06) :842-855
[4]   On-line expectation-maximization algorithm for latent data models [J].
Cappe, Olivier ;
Moulines, Eric .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 :593-613
[5]   Vector autoregression, structural equation modeling, and their synthesis in neuroimaging data analysis [J].
Chen, Gang ;
Glen, Daniel R. ;
Saad, Ziad S. ;
Hamilton, J. Paul ;
Thomason, Moriah E. ;
Gotlib, Ian H. ;
Cox, Robert W. .
COMPUTERS IN BIOLOGY AND MEDICINE, 2011, 41 (12) :1142-1155
[6]   Signal Recovery on Graphs: Variation Minimization [J].
Chen, Siheng ;
Sandryhaila, Aliaksei ;
Moura, Jose M. F. ;
Kovacevic, Jelena .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (17) :4609-4624
[7]   Online Learning With Inexact Proximal Online Gradient Descent Algorithms [J].
Dixit, Rishabh ;
Bedi, Unlit Singh ;
Tripathi, Ruchi ;
Rajawat, Ketan .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (05) :1338-1352
[8]   Learning Graphs From Data [J].
Dong, Xiaowen ;
Thanou, Dorina ;
Rabbat, Michael ;
Frossard, Pascal .
IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (03) :44-63
[9]   Learning Laplacian Matrix in Smooth Graph Signal Representations [J].
Dong, Xiaowen ;
Thanou, Dorina ;
Frossard, Pascal ;
Vandergheynst, Pierre .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (23) :6160-6173
[10]   Sparse inverse covariance estimation with the graphical lasso [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Robert .
BIOSTATISTICS, 2008, 9 (03) :432-441