Relative Comparison-Based Consensus Learning for Multi-View Subspace Clustering

被引:2
作者
Xiao, Xiaolin [1 ]
Wu, Yue [1 ]
Gong, Yue-Jiao [2 ,3 ]
机构
[1] South China Normal Univ, Sch Comp Sci, Guangzhou 510631, Peoples R China
[2] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[3] Univ Elect Sci & Technol China, Shenzhen Inst Adv Study, Shenzhen 610056, Peoples R China
基金
中国国家自然科学基金;
关键词
Clustering algorithms; Data models; Kernel; Computational modeling; Vectors; Tensors; Symmetric matrices; Consensus learning; low-rank representation; multi-view subspace clustering; relative comparison;
D O I
10.1109/TCSVT.2024.3434577
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Current multi-view subspace clustering methods typically consist of a within-view module, which explores inherent characteristics using the self-expressive coefficient matrix, and a cross-view module, which promotes consensus among all views toward similar strengths. However, the self-expressive coefficients are directly influenced by the characteristics and distributions of input features, and coefficient matrices with varying strengths may indicate the same clustering structure. Therefore, directly regularizing the coefficient matrices towards a common matrix is unnecessary and may even diminish the clustering performance. We find that it is the relative data relationship, rather than the absolute similarity, that plays a pivotal role in clustering. Building on this realization, we propose a relative comparison measure that enables a more contextual understanding of the data relationship. Subsequently, we develop a Relative Comparison-based Consensus Learning (RCCL) model for multi-view subspace clustering, which encourages the relative data similarities to be consistent across different views. Our RCCL model advances in identifying the underlying data relationship, avoiding unnecessary constraints on absolute consistency, and thereby delving into the fundamental nature of multi-view consensus. We introduce an elegant transformation operator for relative comparison and solve RCCL under the framework of alternating direction method of multipliers. Extensive experiments unequivocally demonstrated the superiority of RCCL.
引用
收藏
页码:12376 / 12387
页数:12
相关论文
共 51 条
[1]   Multi-view clustering [J].
Bickel, S ;
Scheffer, T .
FOURTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2004, :19-26
[2]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[3]   Multi-view low-rank sparse subspace clustering [J].
Brbic, Maria ;
Kopriva, Ivica .
PATTERN RECOGNITION, 2018, 73 :247-258
[4]  
Chao GQ, 2024, AAAI CONF ARTIF INTE, P11221
[5]   Incomplete multi-view clustering with multiple imputation and ensemble clustering [J].
Chao, Guoqing ;
Wang, Songtao ;
Yang, Shiming ;
Li, Chunshan ;
Chu, Dianhui .
APPLIED INTELLIGENCE, 2022, 52 (13) :14811-14821
[6]   The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent [J].
Chen, Caihua ;
He, Bingsheng ;
Ye, Yinyu ;
Yuan, Xiaoming .
MATHEMATICAL PROGRAMMING, 2016, 155 (1-2) :57-79
[7]   Multiview Subspace Clustering Using Low-Rank Representation [J].
Chen, Jie ;
Yang, Shengxiang ;
Mao, Hua ;
Fahy, Conor .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) :12364-12378
[8]   Multi-view kernel construction [J].
de Sa, Virginia R. ;
Gallagher, Patrick W. ;
Lewis, Joshua M. ;
Malave, Vicente L. .
MACHINE LEARNING, 2010, 79 (1-2) :47-71
[9]   A Comprehensive Survey on Multi-View Clustering [J].
Fang, Uno ;
Li, Man ;
Li, Jianxin ;
Gao, Longxiang ;
Jia, Tao ;
Zhang, Yanchun .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) :12350-12368
[10]   Multi-View Subspace Clustering [J].
Gao, Hongchang ;
Nie, Feiping ;
Li, Xuelong ;
Huang, Heng .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4238-4246