Optimization of identifiability for efficient community detection

被引:122
作者
Li, Hui-Jia [1 ]
Wang, Lin [2 ]
Zhang, Yan [3 ]
Perc, Matjaz [4 ,5 ,6 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Sci, Beijing 100876, Peoples R China
[2] Univ Cambridge, Dept Genet, Cambridge CB2 3EH, England
[3] Alibaba Grp, Alibaba Local Serv Lab, Shanghai 200333, Peoples R China
[4] Univ Maribor, Fac Nat Sci & Math, Koroska Cesta 160, Maribor 2000, Slovenia
[5] China Med Univ, China Med Univ Hosp, Dept Med Res, Taichung, Taiwan
[6] Complex Sci Hub Vienna, Josefstadterstr 39, A-1080 Vienna, Austria
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
complex system; complex network; community detection; matrix factorization; COMPLEX NETWORKS; PHYSICS;
D O I
10.1088/1367-2630/ab8e5e
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Many physical and social systems are best described by networks. And the structural properties of these networks often critically determine the properties and function of the resulting mathematical models. An important method to infer the correlations between topology and function is the detection of community structure, which plays a key role in the analysis, design, and optimization of many complex systems. The nonnegative matrix factorization has been used prolifically to that effect in recent years, although it cannot guarantee balanced partitions, and it also does not allow a proactive computation of the number of communities in a network. This indicates that the nonnegative matrix factorization does not satisfy all the nonnegative low-rank approximation conditions. Here we show how to resolve this important open problem by optimizing the identifiability of community structure. We propose a new form of nonnegative matrix decomposition and a probabilistic surrogate learning function that can be solved according to the majorization-minimization principle. Extensivein silicotests on artificial and real-world data demonstrate the efficient performance in community detection, regardless of the size and complexity of the network.
引用
收藏
页数:10
相关论文
共 49 条
[1]   NP-hardness of Euclidean sum-of-squares clustering [J].
Aloise, Daniel ;
Deshpande, Amit ;
Hansen, Pierre ;
Popat, Preyas .
MACHINE LEARNING, 2009, 75 (02) :245-248
[2]  
[Anonymous], 2014, SNAP DATASETS
[3]   Synchronization in complex networks [J].
Arenas, Alex ;
Diaz-Guilera, Albert ;
Kurths, Jurgen ;
Moreno, Yamir ;
Zhou, Changsong .
PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2008, 469 (03) :93-153
[4]   The statistical physics of cities [J].
Barthelemy, Marc .
NATURE REVIEWS PHYSICS, 2019, 1 (06) :406-415
[5]   Determinants of public cooperation in multiplex networks [J].
Battiston, Federico ;
Perc, Matjaz ;
Latora, Vito .
NEW JOURNAL OF PHYSICS, 2017, 19
[6]   The structure and dynamics of multilayer networks [J].
Boccaletti, S. ;
Bianconi, G. ;
Criado, R. ;
del Genio, C. I. ;
Gomez-Gardenes, J. ;
Romance, M. ;
Sendina-Nadal, I. ;
Wang, Z. ;
Zanin, M. .
PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2014, 544 (01) :1-122
[7]   Complex brain networks: graph theoretical analysis of structural and functional systems [J].
Bullmore, Edward T. ;
Sporns, Olaf .
NATURE REVIEWS NEUROSCIENCE, 2009, 10 (03) :186-198
[8]   Fundamentals of spreading processes in single and multilayer complex networks [J].
de Arruda, Guilherme Ferraz ;
Rodrigues, Francisco A. ;
Moreno, Yamir .
PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2018, 756 :1-59
[9]   Disease Localization in Multilayer Networks [J].
de Arruda, Guilherme Ferraz ;
Cozzo, Emanuele ;
Peixoto, Tiago P. ;
Rodrigues, Francisco A. ;
Moreno, Yamir .
PHYSICAL REVIEW X, 2017, 7 (01)
[10]   Modeling structure and resilience of the dark network [J].
De Domenico, Manlio ;
Arenas, Alex .
PHYSICAL REVIEW E, 2017, 95 (02)