A novel network core structure extraction algorithm utilized variational autoencoder for community detection

被引:20
作者
Fei, Rong [1 ,2 ]
Wan, Yuxin [1 ]
Hu, Bo [3 ]
Li, Aimin [1 ,2 ]
Li, Qian [1 ,2 ]
机构
[1] Xian Univ Technol, Sch Comp Sci & Engn, Xian, Shaanxi, Peoples R China
[2] Shaanxi Key Lab Network Comp & Secur Technol, Xian, Shaanxi, Peoples R China
[3] Hangzhou HollySys Automat Co Ltd, Hangzhou, Zhejiang, Peoples R China
关键词
Community detection; Complex networks; Core structure; Variational autoencoder; Clustering; MODULARITY; INFORMATION;
D O I
10.1016/j.eswa.2023.119775
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Community detection technologies have the general research significance in complex networks, in which the topology information of network is worthy to be the focus for its widely application. It is the definition of community structure that the connection of nodes in the community is dense with the connection of nodes outside the community is sparse, which is corresponding to the core structure in the complex real networks is represented by a compact and dense set of connected nodes. While all the notes in the network are considered by the traditional topology, it is hard to extract the core structure with the continuous, exponential growth of community networks. In this paper, a novel network core structure extraction algorithm utilized variational autoencoder for community detection(CSEA) is proposed for finding the community structure more accurately. Firstly, the K-truss algorithm is used to find the core structure information in the network, and the similarity matrix is generated by similarity mapping combined with local information. Secondly, the variational autoencoder is used to extract and reduce the dimension of the similarity matrix containing the core structure of the network, and the low-dimensional feature matrix is obtained. Finally, the K-means clustering algorithm is utilized to obtain the community structure information. We compare CSEA algorithm with 18 different types of community detection algorithms using 4 evaluation metrics on 19 complex real networks. By extensively evaluating our algorithm on large real-world datasets, we show that CSEA algorithm has an excellent community division effect in dense complex real networks, especially in small and medium-sized networks, and it can accurately divide the complex real networks with unknown community structure. Simultaneously, CSEA algorithm also reveals some efficiency advantage in its on-line test.
引用
收藏
页数:18
相关论文
共 108 条
  • [1] PSEUDO-LIKELIHOOD METHODS FOR COMMUNITY DETECTION IN LARGE SPARSE NETWORKS
    Amini, Arash A.
    Chen, Aiyou
    Bickel, Peter J.
    Levina, Elizaveta
    [J]. ANNALS OF STATISTICS, 2013, 41 (04) : 2097 - 2122
  • [2] A new evolutionary multi-objective community mining algorithm for signed networks
    Attea, Bara'a A.
    Rada, Huda M.
    Abbas, Mustafa N.
    Ozdemir, Suat
    [J]. APPLIED SOFT COMPUTING, 2019, 85
  • [3] Scalable K-Means++
    Bahmani, Bahman
    Moseley, Benjamin
    Vattani, Andrea
    Kumar, Ravi
    Vassilvitskii, Sergei
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (07): : 622 - 633
  • [4] Efficient Enumeration of Maximal k-Plexes
    Berlowitz, Devora
    Cohen, Sara
    Kimelfeld, Benny
    [J]. SIGMOD'15: PROCEEDINGS OF THE 2015 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2015, : 431 - 444
  • [5] A novel orthogonal self-attentive variational autoencoder method for interpretable chemical process fault detection and identification
    Bi, Xiaotian
    Zhao, Jinsong
    [J]. PROCESS SAFETY AND ENVIRONMENTAL PROTECTION, 2021, 156 : 581 - 597
  • [6] Fast unfolding of communities in large networks
    Blondel, Vincent D.
    Guillaume, Jean-Loup
    Lambiotte, Renaud
    Lefebvre, Etienne
    [J]. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2008,
  • [7] Models of social networks based on social distance attachment -: art. no. 056122
    Boguñá, M
    Pastor-Satorras, R
    Díaz-Guilera, A
    Arenas, A
    [J]. PHYSICAL REVIEW E, 2004, 70 (05) : 8 - 1
  • [8] FINDING ALL CLIQUES OF AN UNDIRECTED GRAPH [H]
    BRON, C
    KERBOSCH, J
    [J]. COMMUNICATIONS OF THE ACM, 1973, 16 (09) : 575 - 577
  • [9] A note on the problem of reporting maximal cliques
    Calzals, F.
    Karande, C.
    [J]. THEORETICAL COMPUTER SCIENCE, 2008, 407 (1-3) : 564 - 568
  • [10] Cao SS, 2016, AAAI CONF ARTIF INTE, P1145