Accelerating Bayesian Structure Learning in Sparse Gaussian Graphical Models

被引:13
作者
Mohammadi, Reza [1 ]
Massam, Helene [2 ]
Letac, Gerard [3 ]
机构
[1] Univ Amsterdam, Dept Business Analyt, Amsterdam, Netherlands
[2] York Univ, Dept Math & Stat, N York, ON, Canada
[3] Univ Paul Sabatier, Lab Stat & Probabilites, Toulouse, France
关键词
Bayes factors; Model selection; Normalizing constants; G-Wishart; WISHART DISTRIBUTIONS; INFERENCE; SAMPLER;
D O I
10.1080/01621459.2021.1996377
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Bayesian structure learning in Gaussian graphical models is often done by search algorithms over the graph space.The conjugate prior for the precision matrix satisfying graphical constraints is the well-known G-Wishart.With this prior, the transition probabilities in the search algorithms necessitate evaluating the ratios of the prior normalizing constants of G-Wishart.In moderate to high-dimensions, this ratio is often approximated by using sampling-based methods as computationally expensive updates in the search algorithm.Calculating this ratio so far has been a major computational bottleneck.We overcome this issue by representing a search algorithm in which the ratio of normalizing constants is carried out by an explicit closed-form approximation.Using this approximation within our search algorithm yields significant improvement in the scalability of structure learning without sacrificing structure learning accuracy.We study the conditions under which the approximation is valid.We also evaluate the efficacy of our method with simulation studies.We show that the new search algorithm with our approximation outperforms state-of-the-art methods in both computational efficiency and accuracy.The implementation of our work is available in the R package BDgraph.
引用
收藏
页码:1345 / 1358
页数:14
相关论文
共 28 条
[1]   Statistical mechanics of complex networks [J].
Albert, R ;
Barabási, AL .
REVIEWS OF MODERN PHYSICS, 2002, 74 (01) :47-97
[2]   Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models [J].
Atay-Kayis, A ;
Massam, H .
BIOMETRIKA, 2005, 92 (02) :317-335
[3]   Hierarchical Gaussian graphical models: Beyond reversible jump [J].
Cheng, Yuan ;
Lenkoshi, Alex .
ELECTRONIC JOURNAL OF STATISTICS, 2012, 6 :2309-2331
[4]  
De Iorio M., 2021, ARXIV210801308
[5]   COVARIANCE SELECTION [J].
DEMPSTER, AP .
BIOMETRICS, 1972, 28 (01) :157-&
[6]  
Dobra A, 2021, BDGRAPH BAYESIAN STR
[7]   Bayesian Inference for General Gaussian Graphical Models With Application to Multivariate Lattice Data [J].
Dobra, Adrian ;
Lenkoski, Alex ;
Rodriguez, Abel .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (496) :1418-1433
[8]   COPULA GAUSSIAN GRAPHICAL MODELS AND THEIR APPLICATION TO MODELING FUNCTIONAL DISABILITY DATA [J].
Dobra, Adrian ;
Lenkoski, Alex .
ANNALS OF APPLIED STATISTICS, 2011, 5 (2A) :969-993
[9]   Sparse inverse covariance estimation with the graphical lasso [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Robert .
BIOSTATISTICS, 2008, 9 (03) :432-441
[10]  
Ghahramani Zoubin, 2006, P 22 ANN C UNCERTAIN, P359, DOI DOI 10.5555/3020419.3020463