Bayesian Joint Estimation of Multiple Graphical Models

被引:0
作者
Gan, Lingrui [1 ]
Yang, Xinming [1 ]
Nariestty, Naveen N. [1 ]
Liang, Feng [1 ]
机构
[1] Univ Illinois, Dept Stat, Champaign, IL 61820 USA
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019) | 2019年 / 32卷
关键词
INVERSE COVARIANCE ESTIMATION; VARIABLE SELECTION; INFERENCE; LASSO;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel Bayesian group regularization method based on the spike and slab Lasso priors for jointly estimating multiple graphical models. The proposed method can be used to estimate common sparsity structure underlying the graphical models while capturing potential heterogeneity of the precision matrices corresponding to those models. Our theoretical results show that the proposed method enjoys the optimal rate of convergence in l(infinity) norm for estimation consistency and has a strong structure recovery guarantee even when the signal strengths over different graphs are heterogeneous. Through simulation studies and an application to the capital bike-sharing network data, we demonstrate the competitive performance of our method compared to existing alternatives.
引用
收藏
页数:11
相关论文
共 32 条
[1]   Bayesian structure learning in graphical models [J].
Banerjee, Sayantan ;
Ghosal, Subhashis .
JOURNAL OF MULTIVARIATE ANALYSIS, 2015, 136 :147-162
[2]   Emergence of scaling in random networks [J].
Barabási, AL ;
Albert, R .
SCIENCE, 1999, 286 (5439) :509-512
[3]   A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation [J].
Cai, Tony ;
Liu, Weidong ;
Luo, Xi .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :594-607
[4]   Objective Bayesian model selection in Gaussian graphical models [J].
Carvalho, C. M. ;
Scott, J. G. .
BIOMETRIKA, 2009, 96 (03) :497-512
[5]   The joint graphical lasso for inverse covariance estimation across multiple classes [J].
Danaher, Patrick ;
Wang, Pei ;
Witten, Daniela M. .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2014, 76 (02) :373-397
[6]   COVARIANCE SELECTION [J].
DEMPSTER, AP .
BIOMETRICS, 1972, 28 (01) :157-&
[7]   Bayesian Inference for General Gaussian Graphical Models With Application to Multivariate Lattice Data [J].
Dobra, Adrian ;
Lenkoski, Alex ;
Rodriguez, Abel .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (496) :1418-1433
[8]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[9]   Sparse inverse covariance estimation with the graphical lasso [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Robert .
BIOSTATISTICS, 2008, 9 (03) :432-441
[10]   Bayesian Regularization for Graphical Models With Unequal Shrinkage [J].
Gan, Lingrui ;
Narisetty, Naveen N. ;
Liang, Feng .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (527) :1218-1231