Optimal hypothesis testing for high dimensional covariance matrices

被引:83
作者
Cai, T. Tony [1 ]
Ma, Zongming [1 ]
机构
[1] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
关键词
correlation matrix; covariance matrix; high-dimensional data; likelihood ratio test; minimax hypothesis testing; power; testing covariance structure;
D O I
10.3150/12-BEJ455
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper considers testing a covariance matrix Sigma in the high dimensional setting where the dimension p can be comparable or much larger than the sample size n. The problem of testing the hypothesis H-0 : Sigma = Sigma(0) for a given covariance matrix Sigma(0) is studied from a minimax point of view. We first characterize the boundary that separates the testable region from the non-testable region by the Frobenius norm when the ratio between the dimension p over the sample size n is bounded. A test based on a U-statistic is introduced and is shown to be rate optimal over this asymptotic regime. Furthermore, it is shown that the power of this test uniformly dominates that of the corrected likelihood ratio test (CLRT) over the entire asymptotic regime under which the CLRT is applicable. The power of the U-statistic based test is also analyzed when p/n is unbounded.
引用
收藏
页码:2359 / 2388
页数:30
相关论文
共 18 条
  • [1] Anderson T.W., 2003, Wiley Series in Probability and Statistics
  • [2] [Anonymous], 1982, WILEY SERIES PROBABI
  • [3] CORRECTIONS TO LRT ON LARGE-DIMENSIONAL COVARIANCE MATRIX BY RMT
    Bai, Zhidong
    Jiang, Dandan
    Yao, Jian-Feng
    Zheng, Shurong
    [J]. ANNALS OF STATISTICS, 2009, 37 (6B) : 3822 - 3840
  • [4] A note on testing the covariance matrix for large dimension
    Birke, M
    Dette, H
    [J]. STATISTICS & PROBABILITY LETTERS, 2005, 74 (03) : 281 - 289
  • [5] Cai T. T., 2011, TECHNICAL REPORT
  • [6] LIMITING LAWS OF COHERENCE OF RANDOM MATRICES WITH APPLICATIONS TO TESTING COVARIANCE STRUCTURE AND CONSTRUCTION OF COMPRESSED SENSING MATRICES
    Cai, T. Tony
    Jiang, Tiefeng
    [J]. ANNALS OF STATISTICS, 2011, 39 (03) : 1496 - 1525
  • [7] Tests for High-Dimensional Covariance Matrices
    Chen, Song Xi
    Zhang, Li-Xin
    Zhong, Ping-Shou
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2010, 105 (490) : 810 - 819
  • [8] HEYDE CC, 1970, ANN MATH STAT, V41, P2161, DOI 10.1214/aoms/1177696722
  • [10] Likelihood ratio tests for covariance matrices of high-dimensional normal distributions
    Jiang, Dandan
    Jiang, Tiefeng
    Yang, Fan
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (08) : 2241 - 2256