Optimal hypothesis testing for high dimensional covariance matrices

被引:87
作者
Cai, T. Tony [1 ]
Ma, Zongming [1 ]
机构
[1] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
关键词
correlation matrix; covariance matrix; high-dimensional data; likelihood ratio test; minimax hypothesis testing; power; testing covariance structure;
D O I
10.3150/12-BEJ455
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper considers testing a covariance matrix Sigma in the high dimensional setting where the dimension p can be comparable or much larger than the sample size n. The problem of testing the hypothesis H-0 : Sigma = Sigma(0) for a given covariance matrix Sigma(0) is studied from a minimax point of view. We first characterize the boundary that separates the testable region from the non-testable region by the Frobenius norm when the ratio between the dimension p over the sample size n is bounded. A test based on a U-statistic is introduced and is shown to be rate optimal over this asymptotic regime. Furthermore, it is shown that the power of this test uniformly dominates that of the corrected likelihood ratio test (CLRT) over the entire asymptotic regime under which the CLRT is applicable. The power of the U-statistic based test is also analyzed when p/n is unbounded.
引用
收藏
页码:2359 / 2388
页数:30
相关论文
共 18 条
[1]  
Anderson T.W., 2003, Wiley Series in Probability and Statistics
[2]  
[Anonymous], 1982, WILEY SERIES PROBABI
[3]   CORRECTIONS TO LRT ON LARGE-DIMENSIONAL COVARIANCE MATRIX BY RMT [J].
Bai, Zhidong ;
Jiang, Dandan ;
Yao, Jian-Feng ;
Zheng, Shurong .
ANNALS OF STATISTICS, 2009, 37 (6B) :3822-3840
[4]   A note on testing the covariance matrix for large dimension [J].
Birke, M ;
Dette, H .
STATISTICS & PROBABILITY LETTERS, 2005, 74 (03) :281-289
[5]  
Cai T. T., 2011, TECHNICAL REPORT
[6]   LIMITING LAWS OF COHERENCE OF RANDOM MATRICES WITH APPLICATIONS TO TESTING COVARIANCE STRUCTURE AND CONSTRUCTION OF COMPRESSED SENSING MATRICES [J].
Cai, T. Tony ;
Jiang, Tiefeng .
ANNALS OF STATISTICS, 2011, 39 (03) :1496-1525
[7]   Tests for High-Dimensional Covariance Matrices [J].
Chen, Song Xi ;
Zhang, Li-Xin ;
Zhong, Ping-Shou .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2010, 105 (490) :810-819
[8]  
HEYDE CC, 1970, ANN MATH STAT, V41, P2161, DOI 10.1214/aoms/1177696722
[10]   Likelihood ratio tests for covariance matrices of high-dimensional normal distributions [J].
Jiang, Dandan ;
Jiang, Tiefeng ;
Yang, Fan .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (08) :2241-2256