How Robust Are Reconstruction Thresholds for Community Detection?

被引:38
|
作者
Moitra, Ankur [1 ]
Perry, William [1 ]
Wein, Alexander S. [1 ]
机构
[1] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
来源
STOC'16: PROCEEDINGS OF THE 48TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING | 2016年
关键词
Community detection; stochastic block model; semirandom models; broadcast tree model; semidefinite programming;
D O I
10.1145/2897518.2897573
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle et al. conjectured a sharp threshold for when community detection is possible in the sparse regime. Mossel, Neeman and Sly and Massoulie proved the conjecture and gave matching algorithms and lower bounds. Here we revisit the stochastic block model from the perspective of semirandom models where we allow an adversary to make 'helpful' changes that strengthen ties within each community and break ties between them. We show a surprising result that these 'helpful' changes can shift the information-theoretic threshold, making the community detection problem strictly harder. We complement this by showing that an algorithm based on semidefinite programming (which was known to get close to the threshold) continues to work in the semirandom model (even for partial recovery). This suggests that algorithms based on semidefinite programming are robust in ways that any algorithm meeting the information-theoretic threshold cannot be. These results point to an interesting new direction: Can we find robust, semirandom analogues to some of the classical, average-case thresholds in statistics? We also explore this question in the broadcast tree model, and we show that the viewpoint of semirandom models can help explain why some algorithms are preferred to others in practice, in spite of the gaps in their statistical performance on random models.
引用
收藏
页码:828 / 841
页数:14
相关论文
共 50 条
  • [1] Minimax Rates for Robust Community Detection
    Liu, Allen
    Moitra, Ankur
    2022 IEEE 63RD ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2022, : 823 - 831
  • [2] Community detection thresholds and the weak Ramanujan property
    Massoulie, Laurent
    STOC'14: PROCEEDINGS OF THE 46TH ANNUAL 2014 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2014, : 694 - 703
  • [3] Robust Community Detection in Graphs
    Al-Sharoa, Esraa M.
    Ababneh, Bara' M.
    Alkhassaweneh, Mahmood A.
    IEEE ACCESS, 2021, 9 : 118757 - 118770
  • [4] Community Detection Based on Node Similarity without thresholds
    Benazi, Makhlouf
    Lamiche, Chaabane
    COMPUTER SCIENCE JOURNAL OF MOLDOVA, 2020, 28 (01) : 104 - 119
  • [5] Scalable and Robust Community Detection With Randomized Sketching
    Rahmani, Mostafa
    Beckus, Andre
    Karimian, Adel
    Atia, George K.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 962 - 977
  • [6] Graph reconstruction model for enhanced community detection
    Sun, Peng Gang
    Hu, Jingqi
    Wu, Xunlian
    Zhang, Han
    Quan, Yining
    Miao, Qiguang
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2025, 664
  • [7] Graph reconstruction and attraction method for community detection
    Wu, Xunlian
    Teng, Da
    Zhang, Han
    Hu, Jingqi
    Quan, Yining
    Miao, Qiguang
    Sun, Peng Gang
    APPLIED INTELLIGENCE, 2025, 55 (05)
  • [8] Community Deception or: How to Stop Fearing Community Detection Algorithms
    Fionda, Valeria
    Pirro, Giuseppe
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (04) : 660 - 673
  • [9] Sparsity-aware robust community detection (SPARCODE)
    Tastan, Aylin
    Muma, Michael
    Zoubir, Abdelhak M.
    SIGNAL PROCESSING, 2021, 187
  • [10] RobustECD: Enhancement of Network Structure for Robust Community Detection
    Zhou, Jiajun
    Chen, Zhi
    Du, Min
    Chen, Lihong
    Yu, Shanqing
    Chen, Guanrong
    Xuan, Qi
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 842 - 856