Siamese network with squeeze-attention for incomplete multi-view multi-label classification

被引:0
|
作者
Mengqing Wang [1 ]
Jiarui Chen [1 ]
Lian Zhao [1 ]
Yinghao Ye [1 ]
Xiaohuan Lu [1 ]
机构
[1] Guizhou University,College of Big Data and Information Engineering
关键词
Incomplete multi-view learning; Missing multi-label classification; Siamese network; Dynamic fusion;
D O I
10.1007/s40747-025-01909-6
中图分类号
学科分类号
摘要
Multi-view multi-label classification (MvMLC) has garnered significant interest because of its ability to handle complex datasets. However, the inherent complexity of real-world data often results in incomplete views and missing labels, which limit the richness of data and hinder the accurate association of features with their corresponding categories. Additionally, the MvMLC task is intricate due to the need for diverse views to coherently represent the same entity, thus demanding the creation of stable and consistent multi-view representations that can ensure a reliable feature alignment process across heterogeneous perspectives. To address these challenges, we propose a model based on a Siamese network with squeeze attention (SSA) for incomplete multi-view multi-label classification (iMvMLC). Specifically, to capture the shared semantic information across different views, we combine cross-view collaborative synthesis (CCS) and viewwise representation calibration (VRC) mechanisms. CCS enhances the semantic interaction between views by introducing directive blocks and stacked autoencoders on top of the Siamese network, thereby improving the ability to extract shared semantic representations. The VRC mechanism uses contrastive learning with positive and negative sample pairs to refine the shared semantic space, ensuring higher feature consistency and better alignment across views. Furthermore, considering the task-specific importance variation exhibited by each view, we apply the squeeze attention-weighted fusion (SWF) strategy, which performs feature dimensionality reduction to amplify the key characteristics from each view and enables the model to flexibly adjust the influence of each perspective. Extensive evaluations conducted across five datasets demonstrate that the SSA method outperforms many existing approaches.
引用
收藏
相关论文
共 33 条
  • [1] Incomplete Multi-view Multi-label Active Learning
    Qu, Chuanwei
    Wang, Kuangmeng
    Zhang, Hong
    Yu, Guoxian
    Domeniconi, Carlotta
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 1294 - 1299
  • [2] Deep Double Incomplete Multi-View Multi-Label Learning With Incomplete Labels and Missing Views
    Wen, Jie
    Liu, Chengliang
    Deng, Shijie
    Liu, Yicheng
    Fei, Lunke
    Yan, Ke
    Xu, Yong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 11396 - 11408
  • [3] Confidence-Enhanced Dual-Space Semantic Alignment for partial multi-view incomplete multi-label classification
    Chen, Jiarui
    Xie, Wulin
    Wang, Mengqing
    Ye, Yinghao
    Lu, Xiaohuan
    KNOWLEDGE-BASED SYSTEMS, 2025, 318
  • [4] Skin Medical Image Captioning Using Multi-Label Classification and Siamese Network
    Lin, Yihlon
    Lai, Kuiyou
    Chang, Wenyu
    IEEE ACCESS, 2023, 11 : 23447 - 23454
  • [5] Latent Heterogeneous Graph Network for Incomplete Multi-View Learning
    Zhu, Pengfei
    Yao, Xinjie
    Wang, Yu
    Cao, Meng
    Hui, Binyuan
    Zhao, Shuai
    Hu, Qinghua
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 3033 - 3045
  • [6] Consistent graph embedding network with optimal transport for incomplete multi-view clustering
    Lin, Renjie
    Du, Shide
    Wang, Shiping
    Guo, Wenzhong
    INFORMATION SCIENCES, 2023, 647
  • [7] Cross-view multi-layer perceptron for incomplete multi-view learning
    Wang, Zhi
    Zhou, Heng
    Zhong, Ping
    Zou, Hui
    APPLIED SOFT COMPUTING, 2024, 157
  • [8] Incomplete multi-view learning: Review, analysis, and prospects
    Tang, Jingjing
    Yi, Qingqing
    Fu, Saiji
    Tian, Yingjie
    APPLIED SOFT COMPUTING, 2024, 153
  • [9] Suspicious Object Detection for Millimeter-Wave Images With Multi-View Fusion Siamese Network
    Guo, Dandan
    Tian, Long
    Du, Chuan
    Xie, Pengfei
    Chen, Bo
    Zhang, Lei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4088 - 4102
  • [10] Incomplete Multi-view Learning via Consensus Graph Completion
    Zhang, Heng
    Chen, Xiaohong
    Zhang, Enhao
    Wang, Liping
    NEURAL PROCESSING LETTERS, 2023, 55 (04) : 3923 - 3952