Auto-attention mechanism for multi-view deep emb e dding clustering

被引:33
作者
Diallo, Bassoma [1 ]
Hu, Jie [1 ,2 ,3 ,4 ]
Li, Tianrui [1 ,2 ,3 ,4 ]
Khan, Ghufran Ahmad [6 ]
Liang, Xinyan [5 ]
Wang, Hongjun [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
[2] Minist Educ, Engn Res Ctr Sustainable Urban Intelligent Transpo, Chengdu 611756, Peoples R China
[3] Southwest Jiaotong Univ, Natl Engn Lab Integrated Transportat Big Data Appl, Chengdu 611756, Peoples R China
[4] Southwest Jiaotong Univ, Key Lab Sichuan Prov, Mfg Ind Chains Collaborat & Informat Support Techn, Chengdu 611756, Peoples R China
[5] Shanxi Univ, Inst Big Data Sci & Ind, Taiyuan 030006, Shanxi, Peoples R China
[6] KL Univ, Dept Comp Sci & Applicat, Vaddeswaram 522302, India
关键词
Deep embedding clustering; Deep multi-view clustering; Multi-view autoencoder; Auto-attention; MODEL;
D O I
10.1016/j.patcog.2023.109764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In several fields, deep learning has achieved tremendous success. Multi-view learning is a workable method for handling data from several sources. For clustering multi-view data, deep learning and multi-view learning are excellent options. However, a persistent challenge is a need for the current deep learn-ing approach to independently drive divergent neural networks for different perspectives while working with multi-view data. The current methods use the number of viewpoints to calculate neural network statistics. Consequently, as the number of views rises, it results in a considerable calculation. Further-more, they vainly try to unite various viewpoints at the training. Incorporating a triple fusion technique, this research suggests an innovative multi-view deep embedding clustering (MDEC) model. The suggested model can jointly acquire the specific knowledge in each view as well as the information fragment of the collective views. The main goal of the MDEC is to lower the errors made when learning the features of each view and correlating data from many views. To address the optimization problem, the MDEC model advises a suitable iterative updating approach. In testing modern deep learning and non-deep learning algorithms, the experimental study on small and large-scale multi-view data shows encouraging results for the MDEC model. In multi-view clustering, this work demonstrates the benefit of the deep learning-based approach over the non-ones. However, future work will address a variety of issues related to MDEC including the speed. & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 39 条
[1]   Spectral clustering via ensemble deep autoencoder learning (SC-EDAE) [J].
Affeldt, Severine ;
Labiod, Lazhar ;
Nadif, Mohamed .
PATTERN RECOGNITION, 2020, 108
[2]   Unsupervised discriminative feature learning via finding a clustering-friendly embedding space [J].
Cao, Wenming ;
Zhang, Zhongfan ;
Liu, Cheng ;
Li, Rui ;
Jiao, Qianfen ;
Yu, Zhiwen ;
Wong, Hau-San .
PATTERN RECOGNITION, 2022, 129
[3]   CAAN: Context-Aware attention network for visual question answering [J].
Chen, Chongqing ;
Han, Dezhi ;
Chang, Chin -Chen .
PATTERN RECOGNITION, 2022, 132
[4]   Multi-view subspace clustering via simultaneously learning the representation tensor and affinity matrix [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Zhou, Yicong .
PATTERN RECOGNITION, 2020, 106
[5]   Graph-regularized least squares regression for multi-view subspace clustering [J].
Chen, Yongyong ;
Wang, Shuqin ;
Zheng, Fangying ;
Cen, Yigang .
KNOWLEDGE-BASED SYSTEMS, 2020, 194
[6]   Diversity embedding deep matrix factorization for multi-view clustering [J].
Chen, Zexi ;
Lin, Pengfei ;
Chen, Zhaoliang ;
Ye, Dongyi ;
Wang, Shiping .
INFORMATION SCIENCES, 2022, 610 :114-125
[7]   Deep embedding clustering based on contractive autoencoder [J].
Diallo, Bassoma ;
Hu, Jie ;
Li, Tianrui ;
Khan, Ghufran Ahmad ;
Liang, Xinyan ;
Zhao, Yimiao .
NEUROCOMPUTING, 2021, 433 :96-107
[8]   Multi-view document clustering based on geometrical similarity measurement [J].
Diallo, Bassoma ;
Hu, Jie ;
Li, Tianrui ;
Khan, Ghufran Ahmad ;
Hussein, Ahmed Saad .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (03) :663-675
[9]  
Goh Gabriel, 2017, Why momentum really works
[10]   Deep Clustering with Convolutional Autoencoders [J].
Guo, Xifeng ;
Liu, Xinwang ;
Zhu, En ;
Yin, Jianping .
NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 :373-382