Auto-attention mechanism for multi-view deep emb e dding clustering

被引:27
作者
Diallo, Bassoma [1 ]
Hu, Jie [1 ,2 ,3 ,4 ]
Li, Tianrui [1 ,2 ,3 ,4 ]
Khan, Ghufran Ahmad [6 ]
Liang, Xinyan [5 ]
Wang, Hongjun [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
[2] Minist Educ, Engn Res Ctr Sustainable Urban Intelligent Transpo, Chengdu 611756, Peoples R China
[3] Southwest Jiaotong Univ, Natl Engn Lab Integrated Transportat Big Data Appl, Chengdu 611756, Peoples R China
[4] Southwest Jiaotong Univ, Key Lab Sichuan Prov, Mfg Ind Chains Collaborat & Informat Support Techn, Chengdu 611756, Peoples R China
[5] Shanxi Univ, Inst Big Data Sci & Ind, Taiyuan 030006, Shanxi, Peoples R China
[6] KL Univ, Dept Comp Sci & Applicat, Vaddeswaram 522302, India
关键词
Deep embedding clustering; Deep multi-view clustering; Multi-view autoencoder; Auto-attention; MODEL;
D O I
10.1016/j.patcog.2023.109764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In several fields, deep learning has achieved tremendous success. Multi-view learning is a workable method for handling data from several sources. For clustering multi-view data, deep learning and multi-view learning are excellent options. However, a persistent challenge is a need for the current deep learn-ing approach to independently drive divergent neural networks for different perspectives while working with multi-view data. The current methods use the number of viewpoints to calculate neural network statistics. Consequently, as the number of views rises, it results in a considerable calculation. Further-more, they vainly try to unite various viewpoints at the training. Incorporating a triple fusion technique, this research suggests an innovative multi-view deep embedding clustering (MDEC) model. The suggested model can jointly acquire the specific knowledge in each view as well as the information fragment of the collective views. The main goal of the MDEC is to lower the errors made when learning the features of each view and correlating data from many views. To address the optimization problem, the MDEC model advises a suitable iterative updating approach. In testing modern deep learning and non-deep learning algorithms, the experimental study on small and large-scale multi-view data shows encouraging results for the MDEC model. In multi-view clustering, this work demonstrates the benefit of the deep learning-based approach over the non-ones. However, future work will address a variety of issues related to MDEC including the speed. & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 39 条
  • [1] Spectral clustering via ensemble deep autoencoder learning (SC-EDAE)
    Affeldt, Severine
    Labiod, Lazhar
    Nadif, Mohamed
    [J]. PATTERN RECOGNITION, 2020, 108
  • [2] Unsupervised discriminative feature learning via finding a clustering-friendly embedding space
    Cao, Wenming
    Zhang, Zhongfan
    Liu, Cheng
    Li, Rui
    Jiao, Qianfen
    Yu, Zhiwen
    Wong, Hau-San
    [J]. PATTERN RECOGNITION, 2022, 129
  • [3] CAAN: Context-Aware attention network for visual question answering
    Chen, Chongqing
    Han, Dezhi
    Chang, Chin -Chen
    [J]. PATTERN RECOGNITION, 2022, 132
  • [4] Multi-view subspace clustering via simultaneously learning the representation tensor and affinity matrix
    Chen, Yongyong
    Xiao, Xiaolin
    Zhou, Yicong
    [J]. PATTERN RECOGNITION, 2020, 106
  • [5] Graph-regularized least squares regression for multi-view subspace clustering
    Chen, Yongyong
    Wang, Shuqin
    Zheng, Fangying
    Cen, Yigang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 194
  • [6] Diversity embedding deep matrix factorization for multi-view clustering
    Chen, Zexi
    Lin, Pengfei
    Chen, Zhaoliang
    Ye, Dongyi
    Wang, Shiping
    [J]. INFORMATION SCIENCES, 2022, 610 : 114 - 125
  • [7] Deep embedding clustering based on contractive autoencoder
    Diallo, Bassoma
    Hu, Jie
    Li, Tianrui
    Khan, Ghufran Ahmad
    Liang, Xinyan
    Zhao, Yimiao
    [J]. NEUROCOMPUTING, 2021, 433 : 96 - 107
  • [8] Multi-view document clustering based on geometrical similarity measurement
    Diallo, Bassoma
    Hu, Jie
    Li, Tianrui
    Khan, Ghufran Ahmad
    Hussein, Ahmed Saad
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (03) : 663 - 675
  • [9] Goh G, 2017, Why momentum really works
  • [10] Deep Clustering with Convolutional Autoencoders
    Guo, Xifeng
    Liu, Xinwang
    Zhu, En
    Yin, Jianping
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT II, 2017, 10635 : 373 - 382