THE ASYMPTOTIC DISTRIBUTION AND BERRY-ESSEEN BOUND OF A NEW TEST FOR INDEPENDENCE IN HIGH DIMENSION WITH AN APPLICATION TO STOCHASTIC OPTIMIZATION

被引:63
作者
Liu, Wei-Dong [1 ]
Lin, Zhengyan [1 ]
Shao, Qi-Man [2 ]
机构
[1] Zhejiang Univ, Dept Math, Hangzhou 310027, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Math, Kowloon, Hong Kong, Peoples R China
关键词
Independence test; extreme distribution; Berry-Esseen bound; correlation matrices; stochastic optimization;
D O I
10.1214/08-AAP527
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Let X-1 , . . . , X-n be a random sample from a p-dimensional population distribution. Assume that c(1)n(alpha) <= p <= c(2)n(alpha) for some positive constants c(1), c(2) and alpha. In this paper we introduce a new statistic for testing independence of the p-variates of the population and prove that the limiting distribution is the extreme distribution of type I with a rate of convergence O ((log n)(5/2)/root n). This is much faster than O (1/log n), a typical convergence rate for this type of extreme distribution. A simulation study and application to stochastic optimization are discussed.
引用
收藏
页码:2337 / 2366
页数:30
相关论文
共 22 条
[1]   2 MOMENTS SUFFICE FOR POISSON APPROXIMATIONS - THE CHEN-STEIN METHOD [J].
ARRATIA, R ;
GOLDSTEIN, L ;
GORDON, L .
ANNALS OF PROBABILITY, 1989, 17 (01) :9-25
[2]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[3]  
CHEN J, 2005, INT C AC SPEECH SIGN
[4]   For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution [J].
Donoho, DL .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (06) :797-829
[5]   Stable recovery of sparse overcomplete representations in the presence of noise [J].
Donoho, DL ;
Elad, M ;
Temlyakov, VN .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (01) :6-18
[6]   UNCERTAINTY PRINCIPLES AND SIGNAL RECOVERY [J].
DONOHO, DL ;
STARK, PB .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1989, 49 (03) :906-931
[7]   Optimally sparse representation in general (nonorthogonal) dictionaries via l1 minimization [J].
Donoho, DL ;
Elad, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2003, 100 (05) :2197-2202
[8]   Uncertainty principles and ideal atomic decomposition [J].
Donoho, DL ;
Huo, XM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2001, 47 (07) :2845-2862
[9]  
Donoho DL, 2000, AMS Math Challenges Lecture, DOI DOI 10.1111/J.1751-0813.1937.TB04127.X
[10]   Characterization of LIL behavior in Banach space [J].
Einmahl, Uwe ;
Li, Deli .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 2008, 360 (12) :6677-6693