Optimal hypothesis testing for high dimensional covariance matrices

被引:83
|
作者
Cai, T. Tony [1 ]
Ma, Zongming [1 ]
机构
[1] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
关键词
correlation matrix; covariance matrix; high-dimensional data; likelihood ratio test; minimax hypothesis testing; power; testing covariance structure;
D O I
10.3150/12-BEJ455
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper considers testing a covariance matrix Sigma in the high dimensional setting where the dimension p can be comparable or much larger than the sample size n. The problem of testing the hypothesis H-0 : Sigma = Sigma(0) for a given covariance matrix Sigma(0) is studied from a minimax point of view. We first characterize the boundary that separates the testable region from the non-testable region by the Frobenius norm when the ratio between the dimension p over the sample size n is bounded. A test based on a U-statistic is introduced and is shown to be rate optimal over this asymptotic regime. Furthermore, it is shown that the power of this test uniformly dominates that of the corrected likelihood ratio test (CLRT) over the entire asymptotic regime under which the CLRT is applicable. The power of the U-statistic based test is also analyzed when p/n is unbounded.
引用
收藏
页码:2359 / 2388
页数:30
相关论文
共 50 条
  • [31] Testing high-dimensional covariance matrices with random projections and corrected likelihood ratio
    Sun, Nan
    Tang, Cheng Yong
    STATISTICS AND ITS INTERFACE, 2022, 15 (04) : 449 - 461
  • [32] Testing proportionality of two large-dimensional covariance matrices
    Xu, Lin
    Liu, Baisen
    Zheng, Shurong
    Bao, Shaokun
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 78 : 43 - 55
  • [33] Minimax rate-optimal estimation of high-dimensional covariance matrices with incomplete data
    Cai, T. Tony
    Zhang, Anru
    JOURNAL OF MULTIVARIATE ANALYSIS, 2016, 150 : 55 - 74
  • [34] Estimating structured high-dimensional covariance and precision matrices: Optimal rates and adaptive estimation
    Cai, T. Tony
    Ren, Zhao
    Zhou, Harrison H.
    ELECTRONIC JOURNAL OF STATISTICS, 2016, 10 (01): : 1 - 59
  • [35] Hypothesis tests for high-dimensional covariance structures
    Ishii, Aki
    Yata, Kazuyoshi
    Aoshima, Makoto
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2021, 73 (03) : 599 - 622
  • [36] Testing Kronecker product covariance matrices for high-dimensional matrix-variate data
    Yu, Long
    Xie, Jiahui
    Zhou, Wang
    BIOMETRIKA, 2023, 110 (03) : 799 - 814
  • [37] Testing the equality of two covariance matrices for non-normal high-dimensional data
    Shen, Jieqiong
    Italian Journal of Pure and Applied Mathematics, 2020, 44 : 846 - 858
  • [38] Hypothesis testing for band size detection of high-dimensional banded precision matrices
    An, Baiguo
    Guo, Jianhua
    Liu, Yufeng
    BIOMETRIKA, 2014, 101 (02) : 477 - 483
  • [39] Hypothesis tests for high-dimensional covariance structures
    Aki Ishii
    Kazuyoshi Yata
    Makoto Aoshima
    Annals of the Institute of Statistical Mathematics, 2021, 73 : 599 - 622
  • [40] Testing the equality of two covariance matrices for non-normal high-dimensional data
    Shen, Jieqiong
    ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2020, (44): : 846 - 858