Testing for High-Dimensional Geometry in Random Graphs

被引:78
作者
Bubeck, Sebastien [1 ,2 ]
Ding, Jian [3 ]
Eldan, Ronen [4 ]
Racz, Miklos Z. [5 ]
机构
[1] Princeton Univ, Theory Grp, Microsoft Res, Princeton, NJ 08544 USA
[2] Princeton Univ, Dept Operat Res & Financial Engn, Princeton, NJ 08544 USA
[3] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
[4] Univ Washington, Dept Comp Sci & Engn, Seattle, WA 98195 USA
[5] Univ Calif Berkeley, Dept Stat, Berkeley, CA 94720 USA
关键词
random graphs; random geometric graphs; hypothesis testing; high-dimensional geometric structure; signed triangles; LARGEST EIGENVALUE;
D O I
10.1002/rsa.20633
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We study the problem of detecting the presence of an underlying high-dimensional geometric structure in a random graph. Under the null hypothesis, the observed graph is a realization of an Erdos-Renyi random graphG(n,p). Under the alternative, the graph is generated from theG(n,p,d) model, where each vertex corresponds to a latent independent random vector uniformly distributed on the sphere Sd-1, and two vertices are connected if the corresponding latent vectors are close enough. In the dense regime (i.e., p is a constant), we propose a near-optimal and computationally efficient testing procedure based on a new quantity which we call signed triangles. The proof of the detection lower bound is based on a new bound on the total variation distance between a Wishart matrix and an appropriately normalized GOE matrix. In the sparse regime, we make a conjecture for the optimal detection boundary. We conclude the paper with some preliminary steps on the problem of estimating the dimension in G(n,p,d). (C) 2016 Wiley Periodicals, Inc.
引用
收藏
页码:503 / 532
页数:30
相关论文
共 28 条
[1]  
Abbe E., 2014, IEEE T NETWORK SCI E
[2]  
Abraham I., 2013, P 24 ANN ACM SIAM S, P1853
[3]  
Abramowitz M., 1964, National Bureau of Standards Applied Mathematics Series, DOI DOI 10.1119/1.15378
[4]  
Anderson G. W., 2010, BERNOULLI, V118
[5]  
[Anonymous], 2003, OXFORD STUDIES PROBA
[6]  
[Anonymous], 2013, C LEARN THEOR
[7]  
[Anonymous], 1998, P 9 ANN ACM SIAM S D
[8]  
[Anonymous], 2013, ARXIV13082955
[9]   COMMUNITY DETECTION IN DENSE RANDOM NETWORKS [J].
Arias-Castro, Ery ;
Verzelen, Nicolas .
ANNALS OF STATISTICS, 2014, 42 (03) :940-969
[10]  
Bai Z., 2009, SPECTRAL ANAL LARGE