Structure enhanced deep clustering network via a weighted neighbourhood auto-encoder

被引:18
作者
Bai, Ruina [1 ]
Huang, Ruizhang [1 ]
Zheng, Luyi [1 ]
Chen, Yanping [1 ]
Qin, Yongbin [1 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Structural deep clustering; Graph convolution network; Structure enhanced semantics; Joint supervision;
D O I
10.1016/j.neunet.2022.08.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Structural deep clustering involves the use of neural networks for fusing semantic and structural representations for clustering tasks, and it has been receiving increasing attention. In some pioneering works, auto-encoder (AE)-specific representations were integrated with a graph convolutional network (GCN)-specific representation by delivering semantic information to the GCN module layer-by-layer. Although promising performance has been achieved in various applications, we observed that a vital aspect was overlooked in these works: the structural information may vanish in the learning process because of the over-smoothing problem of the GCN module, leading to non-representative features and, thus, deteriorating clustering performance. In this study, we address this issue by proposing a structure enhanced deep clustering network. The GCN-specific structural data representation is enhanced and supervised by its structural information. Specifically, the GCN-specific structural data representation is strengthened during the learning process by combining it with a structure enhanced semantic (SES) representation. A novel structure enhanced AE, named the weighted neighbourhood AE (wNAE), is employed to learn the SES representation for each data sample. Finally, we design a joint supervision strategy to uniformly guide the simultaneous learning of the wNAE and GCN modules and the clustering assignment. Experimental results for different datasets empirically validate the importance of semantic and neighbour-wise structure learning. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:144 / 154
页数:11
相关论文
共 30 条
[1]   Spectral clustering via ensemble deep autoencoder learning (SC-EDAE) [J].
Affeldt, Severine ;
Labiod, Lazhar ;
Nadif, Mohamed .
PATTERN RECOGNITION, 2020, 108
[2]   Structural Deep Clustering Network [J].
Bo, Deyu ;
Wang, Xiao ;
Shi, Chuan ;
Zhu, Meiqi ;
Lu, Emiao ;
Cui, Peng .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :1400-1410
[3]   Recommendation system exploiting aspect-based opinion mining with deep learning method [J].
Da'u, Aminu ;
Salim, Naomie ;
Rabiu, Idris ;
Osman, Akram .
INFORMATION SCIENCES, 2020, 512 :1279-1292
[4]   Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization [J].
Dizaji, Kamran Ghasedi ;
Herandi, Amirhossein ;
Deng, Cheng ;
Cai, Weidong ;
Huang, Heng .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5747-5756
[5]  
Guo XF, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1753
[6]   GCN-MF: Disease-Gene Association Identification By Graph Convolutional Networks and Matrix Factorization [J].
Han, Peng ;
Yang, Peng ;
Zhao, Peilin ;
Shang, Shuo ;
Liu, Yong ;
Zhou, Jiayu ;
Gao, Xin ;
Kalnis, Panos .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :705-713
[7]  
Hartigan J. A., 1979, Applied Statistics, V28, P100, DOI 10.2307/2346830
[8]   Spatio-temporal feature fusion for dynamic taxi route recommendation via deep reinforcement learning [J].
Ji, Shenggong ;
Wang, Zhaoyuan ;
Li, Tianrui ;
Zheng, Yu .
KNOWLEDGE-BASED SYSTEMS, 2020, 205
[9]  
Lewis DD, 2004, J MACH LEARN RES, V5, P361
[10]  
Li C, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P2594