How Robust Are Reconstruction Thresholds for Community Detection?

被引:38
|
作者
Moitra, Ankur [1 ]
Perry, William [1 ]
Wein, Alexander S. [1 ]
机构
[1] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
来源
STOC'16: PROCEEDINGS OF THE 48TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING | 2016年
关键词
Community detection; stochastic block model; semirandom models; broadcast tree model; semidefinite programming;
D O I
10.1145/2897518.2897573
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle et al. conjectured a sharp threshold for when community detection is possible in the sparse regime. Mossel, Neeman and Sly and Massoulie proved the conjecture and gave matching algorithms and lower bounds. Here we revisit the stochastic block model from the perspective of semirandom models where we allow an adversary to make 'helpful' changes that strengthen ties within each community and break ties between them. We show a surprising result that these 'helpful' changes can shift the information-theoretic threshold, making the community detection problem strictly harder. We complement this by showing that an algorithm based on semidefinite programming (which was known to get close to the threshold) continues to work in the semirandom model (even for partial recovery). This suggests that algorithms based on semidefinite programming are robust in ways that any algorithm meeting the information-theoretic threshold cannot be. These results point to an interesting new direction: Can we find robust, semirandom analogues to some of the classical, average-case thresholds in statistics? We also explore this question in the broadcast tree model, and we show that the viewpoint of semirandom models can help explain why some algorithms are preferred to others in practice, in spite of the gaps in their statistical performance on random models.
引用
收藏
页码:828 / 841
页数:14
相关论文
共 50 条
  • [11] Robust Hierarchical Overlapping Community Detection With Personalized PageRank
    Zhang, Yinglong
    Xia, Xuewen
    Xu, Xing
    Yu, Fei
    Wu, Hongrun
    Yu, Ying
    Wei, Bo
    IEEE ACCESS, 2020, 8 : 102867 - 102882
  • [12] Randomized Robust Matrix Completion for the Community Detection Problem
    Karimian, Adel
    Rahmani, Mostafa
    Beckus, Andre
    Atia, George K.
    2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2018, : 2099 - 2103
  • [13] LinkBlackHole*: Robust Overlapping Community Detection Using Link Embedding
    Kim, Jungeun
    Lim, Sungsu
    Lee, Jae-Gil
    Lee, Byung Suk
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (11) : 2138 - 2150
  • [14] A robust rank aggregation framework for collusive disturbance based on community detection
    Chen, Dongmei
    Xiao, Yu
    Wu, Jun
    Perez, Ignacio Javier
    Herrera-Viedma, Enrique
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (04)
  • [15] Joint Network Reconstruction and Community Detection from Rich but Noisy Data
    Hu, Jie
    Chen, Xiao
    Chen, Yu
    Zhang, Weiping
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2024, 33 (02) : 501 - 514
  • [16] How Significant Attributes are in the Community Detection of Attributed Multiplex Networks
    Cheng, Junwei
    He, Chaobo
    Han, Kunlin
    Ma, Wenjie
    Tang, Yong
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 2057 - 2061
  • [17] Bayesian Community Detection
    van der Pas, S. L.
    van der Vaart, A. W.
    BAYESIAN ANALYSIS, 2018, 13 (03): : 767 - 796
  • [18] A robust two-step algorithm for community detection based on node similarity
    Lounnas, Bilal
    Benazi, Makhlouf
    Kamel, Mohamed
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (16): : 23592 - 23608
  • [19] A robust Bayesian latent position approach for community detection in networks with continuous attributes
    Jin, Zhumengmeng
    Sosa, Juan
    Song, Shangchen
    Betancourt, Brenda
    JOURNAL OF APPLIED STATISTICS, 2024,
  • [20] An optimisation tool for robust community detection algorithms using content and topology information
    Bhih, Amhmed
    Johnson, Princy
    Randles, Martin
    JOURNAL OF SUPERCOMPUTING, 2020, 76 (01): : 226 - 254