Sparse permutation invariant covariance estimation

被引:533
作者
Rothman, Adam J. [1 ]
Bickel, Peter J. [2 ]
Levina, Elizaveta [1 ]
Zhu, Ji [1 ]
机构
[1] Univ Michigan, Ann Arbor, MI 48109 USA
[2] Univ Calif Berkeley, Berkeley, CA 94720 USA
来源
ELECTRONIC JOURNAL OF STATISTICS | 2008年 / 2卷
基金
美国国家科学基金会;
关键词
Covariance matrix; High dimension low sample size; large p small n; Lasso; Sparsity; Cholesky decomposition;
D O I
10.1214/08-EJS176
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a lasso-type penalty. We establish a rate of convergence in the Frobenius norm as both data dimension p and sample size n are allowed to grow, and show that the rate depends explicitly on how sparse the true concentration matrix is. We also show that a correlation-based version of the method exhibits better rates in the operator norm. We also derive a fast iterative algorithm for computing the estimator, which relies on the popular Cholesky decomposition of the inverse but produces a permutation-invariant estimator. The method is compared to other estimators on simulated data and on a real data example of tumor tissue classification using gene expression data.
引用
收藏
页码:494 / 515
页数:22
相关论文
共 36 条