Inferring sparse Gaussian graphical models with latent structure

被引:36
作者
Ambroise, Christophe [1 ]
Chiquet, Julien [1 ]
Matias, Catherine [1 ]
机构
[1] Univ Evry, Lab Stat & Genome, CNRS, UMR 8071,INRA 1152, F-91000 Evry, France
关键词
Gaussian graphical model; Mixture model; penalization; l(1)-penalization; Model selection; Variational inference; EM algorithm; MIXTURE MODEL; SELECTION; LASSO; PREDICTION; INFERENCE;
D O I
10.1214/08-EJS314
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Our concern is selecting the concentration matrix's nonzero coefficients for a sparse Gaussian graphical model in a high-dimensional setting. This corresponds to estimating the graph of conditional dependencies between the variables. We describe a novel framework taking into account a latent structure on the concentration matrix. This latent structure is used to drive a penalty matrix and thus to recover a graphical model with a constrained topology. Our method uses an l(1) penalized likelihood criterion. Inference of the graph of conditional dependencies between the variates and of the hidden variables is performed simultaneously in an iterative EM-like algorithm named SIMoNe (Statistical Inference for Modular Networks). Performances are illustrated on synthetic as well as real data, the latter concerning breast cancer. For gene regulation networks, our method can provide a useful insight both on the mutual influence existing between genes, and on the modules existing in the network.
引用
收藏
页码:205 / 238
页数:34
相关论文
共 38 条
[1]  
[Anonymous], 1977, MAXIMUM LIKELIHOOD I
[2]  
[Anonymous], 1996, OXFORD STAT SCI SERI
[3]  
Banerjee O, 2008, J MACH LEARN RES, V9, P485
[4]   Assessing a mixture model for clustering with the integrated completed likelihood [J].
Biernacki, C ;
Celeux, G ;
Govaert, G .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (07) :719-725
[5]  
Castelo R, 2006, J MACH LEARN RES, V7, P2621
[6]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[7]   SIMoNe: Statistical Inference for MOdular NEtworks [J].
Chiquet, Julien ;
Smith, Alexander ;
Grasseau, Gilles ;
Matias, Catherine ;
Ambroise, Christophe .
BIOINFORMATICS, 2009, 25 (03) :417-418
[8]   A mixture model for random graphs [J].
Daudin, J. -J. ;
Picard, F. ;
Robin, S. .
STATISTICS AND COMPUTING, 2008, 18 (02) :173-183
[9]   COVARIANCE SELECTION [J].
DEMPSTER, AP .
BIOMETRICS, 1972, 28 (01) :157-&
[10]   Sparse graphical models for exploring gene expression data [J].
Dobra, A ;
Hans, C ;
Jones, B ;
Nevins, JR ;
Yao, GA ;
West, M .
JOURNAL OF MULTIVARIATE ANALYSIS, 2004, 90 (01) :196-212