Computational Aspects Related to Inference in Gaussian Graphical Models With the G-Wishart Prior

被引:58
作者
Lenkoski, Alex [1 ]
Dobra, Adrian [2 ]
机构
[1] Heidelberg Univ, Dept Appl Math, Heidelberg, Germany
[2] Univ Washington, Dept Stat, Seattle, WA 98195 USA
关键词
Bayesian model averaging; Covariance estimation; Covariance selection; Multivariate regression; Stochastic search; COVARIANCE-MATRIX; EXPONENTIAL-FAMILIES; DECOMPOSABLE GRAPHS; BAYESIAN-INFERENCE; SELECTION; DISTRIBUTIONS; LIKELIHOOD; DENSITIES;
D O I
10.1198/jcgs.2010.08181
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We describe a comprehensive framework for performing Bayesian inference for Gaussian graphical models based on the G-Wishart prior with a special focus on efficiently including nondecomposable graphs in the model space. We develop a new approximation method to the normalizing constant of a G-Wishart distribution based on the Laplace approximation. We review recent developments in stochastic search algorithms and propose a new method, the mode oriented stochastic search (MOSS), that extends these techniques and proves superior at quickly finding graphical models with high posterior probability. We then develop a novel stochastic search technique for multivariate regression models and conclude with a real-world example from the recent covariance estimation literature. Supplemental materials are available online.
引用
收藏
页码:140 / 157
页数:18
相关论文
共 41 条
[1]  
[Anonymous], 2003, Sankhy: The Indian Journal of Statistics
[2]   Functionally compatible local characteristics for the local specification of priors in graphical models [J].
Asci, Claudio ;
Piccioni, Mauro .
SCANDINAVIAN JOURNAL OF STATISTICS, 2007, 34 (04) :829-840
[3]   Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models [J].
Atay-Kayis, A ;
Massam, H .
BIOMETRIKA, 2005, 92 (02) :317-335
[4]  
Barnard J, 2000, STAT SINICA, V10, P1281
[5]   Posterior model probabilities via path-based pairwise priors [J].
Berger, JO ;
Molina, G .
STATISTICA NEERLANDICA, 2005, 59 (01) :3-15
[6]   Regularized estimation of large covariance matrices [J].
Bickel, Peter J. ;
Levina, Elizaveta .
ANNALS OF STATISTICS, 2008, 36 (01) :199-227
[7]   FINDING ALL CLIQUES OF AN UNDIRECTED GRAPH [H] [J].
BRON, C ;
KERBOSCH, J .
COMMUNICATIONS OF THE ACM, 1973, 16 (09) :575-577
[8]  
Carvalho C.M., 2007, BIOMETRIKA, V7, P269
[9]   Nonconjugate Bayesian estimation of covariance matrices and its use in hierarchical models [J].
Daniels, MJ ;
Kass, RE .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1999, 94 (448) :1254-1263
[10]   HYPER MARKOV LAWS IN THE STATISTICAL-ANALYSIS OF DECOMPOSABLE GRAPHICAL MODELS [J].
DAWID, AP ;
LAURITZEN, SL .
ANNALS OF STATISTICS, 1993, 21 (03) :1272-1317