High-dimensional covariance matrix estimation with missing observations

被引:108
作者
Lounici, Karim [1 ]
机构
[1] Georgia Inst Technol, Sch Math, Atlanta, GA 30332 USA
关键词
covariance matrix; Lasso; low-rank matrix estimation; missing observations; non-commutative Bernstein inequality; optimal rate of convergence; DANTZIG SELECTOR; OPTIMAL RATES; CONVERGENCE; COMPLETION; EQUATIONS; LASSO; MODEL;
D O I
10.3150/12-BEJ487
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we study the problem of high-dimensional covariance matrix estimation with missing observations. We propose a simple procedure computationally tractable in high-dimension and that does not require imputation of the missing data. We establish non-asymptotic sparsity oracle inequalities for the estimation of the covariance matrix involving the Frobenius and the spectral norms which are valid for any setting of the sample size, probability of a missing observation and the dimensionality of the covariance matrix. We further establish minimax lower bounds showing that our rates are minimax optimal up to a logarithmic factor.
引用
收藏
页码:1029 / 1058
页数:30
相关论文
共 36 条
[1]   Strong converse for identification via quantum channels [J].
Ahlswede, R ;
Winter, A .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2002, 48 (03) :569-579
[2]  
[Anonymous], LECT NOTES MATH
[3]  
Banerjee O, 2008, J MACH LEARN RES, V9, P485
[4]   SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR [J].
Bickel, Peter J. ;
Ritov, Ya'acov ;
Tsybakov, Alexandre B. .
ANNALS OF STATISTICS, 2009, 37 (04) :1705-1732
[5]   COVARIANCE REGULARIZATION BY THRESHOLDING [J].
Bickel, Peter J. ;
Levina, Elizaveta .
ANNALS OF STATISTICS, 2008, 36 (06) :2577-2604
[6]   OPTIMAL SELECTION OF REDUCED RANK ESTIMATORS OF HIGH-DIMENSIONAL MATRICES [J].
Bunea, Florentina ;
She, Yiyuan ;
Wegkamp, Marten H. .
ANNALS OF STATISTICS, 2011, 39 (02) :1282-1309
[7]   OPTIMAL RATES OF CONVERGENCE FOR COVARIANCE MATRIX ESTIMATION [J].
Cai, T. Tony ;
Zhang, Cun-Hui ;
Zhou, Harrison H. .
ANNALS OF STATISTICS, 2010, 38 (04) :2118-2144
[8]   A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation [J].
Cai, Tony ;
Liu, Weidong ;
Luo, Xi .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :594-607
[9]   Adaptive Thresholding for Sparse Covariance Matrix Estimation [J].
Cai, Tony ;
Liu, Weidong .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :672-684
[10]  
Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523