Detecting positive correlations in a multivariate sample

被引:16
作者
Arias-Castro, Ery [1 ]
Bubeck, Sebastien [2 ]
Lugosi, Gabor [3 ]
机构
[1] Univ Calif San Diego, Dept Math, La Jolla, CA 92093 USA
[2] Princeton Univ, Dept Operat Res & Financial Engn, Princeton, NJ 08544 USA
[3] Pompeu Fabra Univ, Dept Econ, Barcelona 08005, Spain
关键词
Bayesian detection; high-dimensional data; minimax detection; random geometric graphs; sparse covariance matrix; sparse detection; COVARIANCE-MATRIX; HIGHER CRITICISM; TESTS; CLIQUE; RATES;
D O I
10.3150/13-BEJ565
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the problem of testing whether a correlation matrix of a multivariate normal population is the identity matrix. We focus on sparse classes of alternatives where only a few entries are nonzero and, in fact, positive. We derive a general lower bound applicable to various classes and study the performance of some near-optimal tests. We pay special attention to computational feasibility and construct near-optimal tests that can be computed efficiently. Finally, we apply our results to prove new lower bounds for the clique number of high-dimensional random geometric graphs.
引用
收藏
页码:209 / 241
页数:33
相关论文
共 32 条
  • [1] ON COMBINATORIAL TESTING PROBLEMS
    Addario-Berry, Louigi
    Broutin, Nicolas
    Devroye, Luc
    Lugosi, Gabor
    [J]. ANNALS OF STATISTICS, 2010, 38 (05) : 3063 - 3092
  • [2] Alon N, 1998, RANDOM STRUCT ALGOR, V13, P457, DOI 10.1002/(SICI)1098-2418(199810/12)13:3/4<457::AID-RSA14>3.0.CO
  • [3] 2-W
  • [4] [Anonymous], COMPUTATIONAL LOWER
  • [5] Searching for a trail of evidence in a maze
    Arias-Castro, Ery
    Candes, Emmanuel J.
    Helgason, Hannes
    Zeitouni, Ofer
    [J]. ANNALS OF STATISTICS, 2008, 36 (04) : 1726 - 1757
  • [6] DETECTION OF CORRELATIONS
    Arias-Castro, Ery
    Bubeck, Sebastien
    Lugosi, Gabor
    [J]. ANNALS OF STATISTICS, 2012, 40 (01) : 412 - 435
  • [7] Baraud Y, 2002, BERNOULLI, V8, P577
  • [8] Berman S.M., 1962, SANKHYA SER A, V24, P155
  • [9] OPTIMAL DETECTION OF SPARSE PRINCIPAL COMPONENTS IN HIGH DIMENSION
    Berthet, Quentin
    Rigollet, Philippe
    [J]. ANNALS OF STATISTICS, 2013, 41 (04) : 1780 - 1815
  • [10] Regularized estimation of large covariance matrices
    Bickel, Peter J.
    Levina, Elizaveta
    [J]. ANNALS OF STATISTICS, 2008, 36 (01) : 199 - 227