Sparse random hypergraphs: non-backtracking spectra and community detection

被引:1
作者
Stephan, Ludovic [1 ]
Zhu, Yizhe [2 ]
机构
[1] Ecole Polytech Fed Lausanne EPFL, Informat Learning & Phys IdePHICS Lab, Route Cantonale, CH-1015 Lausanne, VD, Switzerland
[2] Univ Calif Irvine, Dept Math, 510 V Rowland Hall, Irvine, CA 92697 USA
关键词
stochastic block model; random hypergraph; community detection; non-backtracking operator; Kesten-Stigum threshold; 2ND EIGENVALUE; EXACT RECOVERY; RECONSTRUCTION; CONSISTENCY; ALGORITHMS; PROOF;
D O I
10.1093/imaiai/iaae004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the community detection problem in a sparse q-uniform hypergraph G, assuming that G is generated according to the Hypergraph Stochastic Block Model (HSBM). We prove that a spectral method based on the non-backtracking operator for hypergraphs works with high probability down to the generalized Kesten-Stigum detection threshold conjectured by Angelini et al. (2015, Spectral detection on sparse hypergraphs. In: 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton). IEEE, pp. 66-73). We characterize the spectrum of the non-backtracking operator for the sparse HSBM and provide an efficient dimension reduction procedure using the Ihara-Bass formula for hypergraphs. As a result, community detection for the sparse HSBM on n vertices can be reduced to an eigenvector problem of a 2n x 2n non-normal matrix constructed from the adjacency matrix and the degree matrix of the hypergraph. To the best of our knowledge, this is the first provable and efficient spectral algorithm that achieves the conjectured threshold for HSBMs with r blocks generated according to a general symmetric probability tensor.
引用
收藏
页数:70
相关论文
共 90 条
[1]   LEARNING SPARSE GRAPHONS AND THE GENERALIZED KESTEN-STIGUM THRESHOLD [J].
Abbe, Emmanuel ;
Li, Shuangping ;
Sly, Allan .
ANNALS OF STATISTICS, 2023, 51 (02) :599-623
[2]   Graph Powering and Spectral Robustness [J].
Abbe, Emmanuel ;
Boix-Adsera, Enric ;
Ralli, Peter ;
Sandon, Colin .
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2020, 2 (01) :132-157
[3]  
Abbe E, 2018, J MACH LEARN RES, V18
[4]   Proof of the Achievability Conjectures for the General Stochastic Block Model [J].
Abbe, Emmanuel ;
Sandon, Colin .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2018, 71 (07) :1334-1406
[5]   Exact Recovery in the Stochastic Block Model [J].
Abbe, Emmanuel ;
Bandeira, Afonso S. ;
Hall, Georgina .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (01) :471-487
[6]   Community detection in general stochastic block models: fundamental limits and efficient algorithms for recovery [J].
Abbe, Emmanuel ;
Sandon, Colin .
2015 IEEE 56TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, 2015, :670-688
[7]   Community Recovery in Hypergraphs [J].
Ahn, Kwangjun ;
Lee, Kangwook ;
Suh, Changho .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (10) :6561-6579
[8]   Hypergraph Spectral Clustering in the Weighted Stochastic Block Model [J].
Ahn, Kwangjun ;
Lee, Kangwook ;
Suh, Changho .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2018, 12 (05) :959-974
[9]   Hypernetwork science via high-order hypergraph walks [J].
Aksoy, Sinan G. ;
Joslyn, Cliff ;
Marrero, Carlos Ortiz ;
Praggastis, Brenda ;
Purvine, Emilie .
EPJ DATA SCIENCE, 2020, 9 (01)
[10]   Delocalization Transition for Critical Erdos-Renyi Graphs [J].
Alt, Johannes ;
Ducatez, Raphael ;
Knowles, Antti .
COMMUNICATIONS IN MATHEMATICAL PHYSICS, 2021, 388 (01) :507-579