Multigranularity Information Fused Contrastive Learning With Multiview Clustering

被引:0
作者
Ju, Hengrong [1 ,2 ]
Lu, Yang [1 ]
Ding, Weiping [1 ]
Zhang, Wei [1 ]
Yang, Xibei [3 ]
机构
[1] Nantong Univ, Sch Artificial Intelligence & Comp Sci, Nantong 226019, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210000, Peoples R China
[3] Jiangsu Univ Sci & Technol, Sch Comp, Zhenjiang 212100, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; Feature extraction; Semantics; Data mining; Training; Representation learning; Fuses; Electronic mail; Adaptation models; Software; Deep clustering; granular computing; multiview clustering (MVC); multiview contrastive learning;
D O I
10.1109/TNNLS.2025.3574885
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contrastive multiview clustering (MVC) has emerged as a mainstream approach in MVC due to its superior representation learning capabilities. Traditional contrastive multiview learning methods extract both low- and high-level information from raw data. However, only high-level information is utilized for clustering. Since both types of information are essential for effective clustering, this limitation hampers performance. Moreover, effectively quantifying the importance of different views remains a critical challenge in contrastive MVC. Additionally, the absence of structural information during clustering further weakens clustering performance. To address these issues, this article proposes a multigranularity (MG) information fused contrastive learning with MVC (MGCMVC). Inspired by the concept of MG, low- and high-level features are reconstructed into fine- and coarse-granularity features. First, an MG adaptive weighting sample-level contrastive learning mechanism is introduced to fuse MG features to enhance clustering performance and mitigate clustering performance degradation caused by variations in view quality. Second, a structure-oriented cluster-level contrastive learning approach is designed to preserve structural information and enforce cross-view clustering consistency. Extensive and comprehensive experiments on ten widely used datasets demonstrate that MGCMVC achieves the state-of-the-art performance. The source code is available at https://github.com/Luyangabc/MGCMVC
引用
收藏
页数:15
相关论文
共 54 条
[1]   Deep Multimodal Subspace Clustering Networks [J].
Abavisani, Mahdi ;
Patel, Vishal M. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2018, 12 (06) :1601-1614
[2]   Structural deep multi-view clustering with integrated abstraction and detail [J].
Chen, Bowei ;
Xu, Sen ;
Xu, Heyang ;
Bian, Xuesheng ;
Guo, Naixuan ;
Xu, Xiufang ;
Hua, Xiaopeng ;
Zhou, Tian .
NEURAL NETWORKS, 2024, 175
[3]   Deep Multiview Clustering by Contrasting Cluster Assignments [J].
Chen, Jie ;
Mao, Hua ;
Woo, Wai Lok ;
Peng, Xi .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :16706-16715
[4]  
Chen T., 2020, PMLR, P1597
[5]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[6]   Progressive Learning of Category-Consistent Multi-Granularity Features for Fine-Grained Visual Classification [J].
Du, Ruoyi ;
Xie, Jiyang ;
Ma, Zhanyu ;
Chang, Dongliang ;
Song, Yi-Zhe ;
Guo, Jun .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) :9521-9535
[7]  
Glorot X., 2011, INT C ART INT STAT, V15, P315
[8]  
Guo R., 2024, P ADV NEUR INF PROC, V37
[9]   Tensor-Based Adaptive Consensus Graph Learning for Multi-View Clustering [J].
Guo, Wei ;
Che, Hangjun ;
Leung, Man-Fai .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (02) :4767-4784
[10]  
He Changhao, 2024, MM '24: Proceedings of the 32nd ACM International Conference on Multimedia, P4167, DOI 10.1145/3664647.3681331