INNOVATED SCALABLE EFFICIENT ESTIMATION IN ULTRA-LARGE GAUSSIAN GRAPHICAL MODELS

被引:37
作者
Fan, Yingying [1 ]
Lv, Jinchi [1 ]
机构
[1] Univ Southern Calif, Marshall Sch Business, Dept Data Sci & Operat, Los Angeles, CA 90089 USA
关键词
Gaussian graphical model; precision matrix; big data; scalability; efficiency; sparsity; COVARIANCE-MATRIX ESTIMATION; NONCONCAVE PENALIZED LIKELIHOOD; FALSE DISCOVERY RATE; VARIABLE SELECTION; ORACLE PROPERTIES; DANTZIG SELECTOR; ADAPTIVE LASSO; REGRESSION; CLASSIFICATION;
D O I
10.1214/15-AOS1416
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Large-scale precision matrix estimation is of fundamental importance yet challenging in many contemporary applications for recovering Gaussian graphical models. In this paper, we suggest a new approach of innovated scalable efficient estimation (ISEE) for estimating large precision matrix. Motivated by the innovated transformation, we convert the original problem into that of large covariance matrix estimation. The suggested method combines the strengths of recent advances in high-dimensional sparse modeling and large covariance matrix estimation. Compared to existing approaches, our method is scalable and can deal with much larger precision matrices with simple tuning. Under mild regularity conditions, we establish that this procedure can recover the underlying graphical structure with significant probability and provide efficient estimation of link strengths. Both computational and theoretical advantages of the procedure are evidenced through simulation and real data examples.
引用
收藏
页码:2098 / 2126
页数:29
相关论文
共 48 条
[1]  
[Anonymous], 1996, GRAPHICAL MODELS
[2]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[3]   Regularized estimation of large covariance matrices [J].
Bickel, Peter J. ;
Levina, Elizaveta .
ANNALS OF STATISTICS, 2008, 36 (01) :199-227
[4]   COVARIANCE REGULARIZATION BY THRESHOLDING [J].
Bickel, Peter J. ;
Levina, Elizaveta .
ANNALS OF STATISTICS, 2008, 36 (06) :2577-2604
[5]  
Cai T. T., 2014, ANN STAT IN PRESS
[6]   ADAPTIVE COVARIANCE MATRIX ESTIMATION THROUGH BLOCK THRESHOLDING [J].
Cai, Tony ;
Yuan, Ming .
ANNALS OF STATISTICS, 2012, 40 (04) :2014-2042
[7]   A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation [J].
Cai, Tony ;
Liu, Weidong ;
Luo, Xi .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :594-607
[8]   Adaptive Thresholding for Sparse Covariance Matrix Estimation [J].
Cai, Tony ;
Liu, Weidong .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :672-684
[9]  
Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523
[10]   COVARIANCE SELECTION [J].
DEMPSTER, AP .
BIOMETRICS, 1972, 28 (01) :157-&