Iterative Deep Structural Graph Contrast Clustering for Multiview Raw Data

被引:2
作者
Dong, Zhibin [1 ]
Jin, Jiaqi [1 ]
Xiao, Yuyang [2 ]
Wang, Siwei [3 ]
Zhu, Xinzhong [4 ]
Liu, Xinwang [1 ]
Zhu, En [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha 410073, Peoples R China
[2] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410073, Peoples R China
[3] Intelligent Game & Decis Lab, Beijing 100071, Peoples R China
[4] Zhejiang Normal Univ, Coll Math Phys & Informat Engn, Jinhua 321004, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive clustering; graph representation learning (RL); multiple graph clustering;
D O I
10.1109/TNNLS.2023.3313692
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multiview clustering has attracted increasing attention to automatically divide instances into various groups without manual annotations. Traditional shadow methods discover the internal structure of data, while deep multiview clustering (DMVC) utilizes neural networks with clustering-friendly data embeddings. Although both of them achieve impressive performance in practical applications, we find that the former heavily relies on the quality of raw features, while the latter ignores the structure information of data. To address the above issue, we propose a novel method termed iterative deep structural graph contrast clustering (IDSGCC) for multiview raw data consisting of topology learning (TL), representation learning (RL), and graph structure contrastive learning to achieve better performance. The TL module aims to obtain a structured global graph with constraint structural information and then guides the RL to preserve the structural information. In the RL module, graph convolutional network (GCN) takes the global structural graph and raw features as inputs to aggregate the samples of the same cluster and keep the samples of different clusters away. Unlike previous methods performing contrastive learning at the representation level of the samples, in the graph contrastive learning module, we conduct contrastive learning at the graph structure level by imposing a regularization term on the similarity matrix. The credible neighbors of the samples are constructed as positive pairs through the credible graph, and other samples are constructed as negative pairs. The three modules promote each other and finally obtain clustering-friendly embedding. Also, we set up an iterative update mechanism to update the topology to obtain a more credible topology. Impressive clustering results are obtained through the iterative mechanism. Comparative experiments on eight multiview datasets show that our model outperforms the state-of-the-art traditional and deep clustering competitors.
引用
收藏
页码:18272 / 18284
页数:13
相关论文
共 69 条
[1]  
Amini M.-R., 2009, P INT C NEUR INF PRO, V22, P28
[2]   A review of robust clustering methods [J].
Angel Garcia-Escudero, Luis ;
Gordaliza, Alfonso ;
Matran, Carlos ;
Mayo-Iscar, Agustin .
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2010, 4 (2-3) :89-109
[3]  
Berkhin P, 2006, GROUPING MULTIDIMENSIONAL DATA: RECENT ADVANCES IN CLUSTERING, P25
[5]  
Cai X., 2013, PROC 23 INT JOINT C
[6]   Adaptive Transition Probability Matrix Learning for Multiview Spectral Clustering [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Hua, Zhongyun ;
Zhou, Yicong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) :4712-4726
[7]  
Duan JC, 2023, Arxiv, DOI [arXiv:2211.15255, DOI arXiv:2211.15255.v1]
[8]   Sparse Subspace Clustering: Algorithm, Theory, and Applications [J].
Elhamifar, Ehsan ;
Vidal, Rene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2765-2781
[10]   One2Multi Graph Autoencoder for Multi-view Graph Clustering [J].
Fan, Shaohua ;
Wang, Xiao ;
Shi, Chuan ;
Lu, Emiao ;
Lin, Ken ;
Wang, Bai .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :3070-3076