How Robust Are Reconstruction Thresholds for Community Detection?

被引:38
作者
Moitra, Ankur [1 ]
Perry, William [1 ]
Wein, Alexander S. [1 ]
机构
[1] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
来源
STOC'16: PROCEEDINGS OF THE 48TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING | 2016年
关键词
Community detection; stochastic block model; semirandom models; broadcast tree model; semidefinite programming;
D O I
10.1145/2897518.2897573
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle et al. conjectured a sharp threshold for when community detection is possible in the sparse regime. Mossel, Neeman and Sly and Massoulie proved the conjecture and gave matching algorithms and lower bounds. Here we revisit the stochastic block model from the perspective of semirandom models where we allow an adversary to make 'helpful' changes that strengthen ties within each community and break ties between them. We show a surprising result that these 'helpful' changes can shift the information-theoretic threshold, making the community detection problem strictly harder. We complement this by showing that an algorithm based on semidefinite programming (which was known to get close to the threshold) continues to work in the semirandom model (even for partial recovery). This suggests that algorithms based on semidefinite programming are robust in ways that any algorithm meeting the information-theoretic threshold cannot be. These results point to an interesting new direction: Can we find robust, semirandom analogues to some of the classical, average-case thresholds in statistics? We also explore this question in the broadcast tree model, and we show that the viewpoint of semirandom models can help explain why some algorithms are preferred to others in practice, in spite of the gaps in their statistical performance on random models.
引用
收藏
页码:828 / 841
页数:14
相关论文
共 50 条
  • [41] Semidefinite Programming for Community Detection With Side Information
    Esmaeili, Mohammad
    Saad, Hussein Metwaly
    Nosratinia, Aria
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (02): : 1957 - 1973
  • [42] Hypothesis testing for automated community detection in networks
    Bickel, Peter J.
    Sarkar, Purnamrita
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2016, 78 (01) : 253 - 273
  • [43] Phylogenetic reconstruction of the cultural evolution of electronic music via dynamic community detection (1975-1999)
    Youngblood, Mason
    Baraghith, Karim
    Savage, Patrick E.
    EVOLUTION AND HUMAN BEHAVIOR, 2021, 42 (06) : 573 - 582
  • [44] LSMD: A fast and robust local community detection starting from low degree nodes in social networks
    Bouyer, Asgarali
    Roghani, Hamid
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 113 : 41 - 57
  • [45] Robust Overlapping Community Detection in Complex Networks With Graph Convolutional Networks and Fuzzy C-Means
    Al-andoli, Mohammed Nasser
    Irianto
    AlSayaydeh, Jamil Abedalrahim
    Alwayle, Ibrahim M.
    Mohd, Che Ku Nuraini Che Ku
    Abuhoureyah, Fahd
    IEEE ACCESS, 2024, 12 : 70129 - 70145
  • [46] Community detection with fuzzy community structure
    Wang, Qinna
    Fleury, Eric
    2011 INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM 2011), 2011, : 575 - 580
  • [47] A Supervised Approach to Community Detection Problem: How to Improve Louvain Algorithm by Considering Fuzzy Measures
    Barroso, Maria
    Gomez, Daniel
    Gutierrez, Inmaculada
    INTELLIGENT AND FUZZY SYSTEMS: DIGITAL ACCELERATION AND THE NEW NORMAL, INFUS 2022, VOL 1, 2022, 504 : 219 - 227
  • [48] Trust Your Data or Not-StQP Remains StQP: Community Detection via Robust Standard Quadratic Optimization
    Bomze, Immanuel M.
    Kahr, Michael
    Leitner, Markus
    MATHEMATICS OF OPERATIONS RESEARCH, 2021, 46 (01) : 301 - 316
  • [49] Distributed Community Detection on Overlapping Stochastic Block Model
    Xu, Jiasheng
    Fu, Luoyi
    Gan, Xiaoying
    Zhu, Bo
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 201 - 206
  • [50] Community detection in the sparse hypergraph stochastic block model
    Pal, Soumik
    Zhu, Yizhe
    RANDOM STRUCTURES & ALGORITHMS, 2021, 59 (03) : 407 - 463