High dimensional sparse covariance estimation via directed acyclic graphs

被引:22
作者
Ruetimann, Philipp [1 ]
Buehlmann, Peter [1 ]
机构
[1] ETH Zentrum, Seminar Stat, CH-8092 Zurich, Switzerland
关键词
Concentration matrix; covariance matrix; directed acyclic graphs; graphical Lasso; high-dimensional data; PC-algorithm; MATRICES; SELECTION;
D O I
10.1214/09-EJS534
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present a graph-based technique for estimating sparse covariance matrices and their inverses from high-dimensional data. The method is based on learning a directed acyclic graph (GAG) and estimating parameters of a multivariate Gaussian distribution based on a DAG. For inferring the underlying DAG we use the PC-algorithm [27] and for estimating the DAG based covariance matrix and its inverse, we use a Cholesky decomposition approach which provides a positive (semi-)definite sparse estimate. We present a consistency result in the high-dimensional framework and we compare our method with the Glasso [12, 8, 2] for simulated and real data.
引用
收藏
页码:1133 / 1160
页数:28
相关论文
共 31 条
[1]  
Anderson T. W., 1984, An introduction to multivariate statistical analysis, V499
[2]  
[Anonymous], 1996, OXFORD STAT SCI SERI
[3]  
[Anonymous], 2000, CAUSATION PREDICTION
[4]  
Banerjee O, 2008, J MACH LEARN RES, V9, P485
[5]   Regularized estimation of large covariance matrices [J].
Bickel, Peter J. ;
Levina, Elizaveta .
ANNALS OF STATISTICS, 2008, 36 (01) :199-227
[6]   COVARIANCE REGULARIZATION BY THRESHOLDING [J].
Bickel, Peter J. ;
Levina, Elizaveta .
ANNALS OF STATISTICS, 2008, 36 (06) :2577-2604
[7]   Some theory for Fisher's linear discriminant function, 'naive Bayes', and some alternatives when there are many more variables than observations [J].
Bickel, PJ ;
Levina, E .
BERNOULLI, 2004, 10 (06) :989-1010
[8]   Estimation of a covariance matrix with zeros [J].
Chaudhuri, Sanjay ;
Drton, Mathias ;
Richardson, Thomas S. .
BIOMETRIKA, 2007, 94 (01) :199-216
[9]  
Cox D, 1996, MONOGRAPHS STAT APPL
[10]   First-order methods for sparse covariance selection [J].
D'Aspremont, Alexandre ;
Banerjee, Onureena ;
El Ghaoui, Laurent .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (01) :56-66