Siamese network with squeeze-attention for incomplete multi-view multi-label classification

被引:0
作者
Wang, Mengqing [1 ]
Chen, Jiarui [1 ]
Zhao, Lian [1 ]
Ye, Yinghao [1 ]
Lu, Xiaohuan [1 ]
机构
[1] Guizhou Univ, Coll Big Data & Informat Engn, Guiyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Incomplete multi-view learning; Missing multi-label classification; Siamese network; Dynamic fusion; MODEL;
D O I
10.1007/s40747-025-01909-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-view multi-label classification (MvMLC) has garnered significant interest because of its ability to handle complex datasets. However, the inherent complexity of real-world data often results in incomplete views and missing labels, which limit the richness of data and hinder the accurate association of features with their corresponding categories. Additionally, the MvMLC task is intricate due to the need for diverse views to coherently represent the same entity, thus demanding the creation of stable and consistent multi-view representations that can ensure a reliable feature alignment process across heterogeneous perspectives. To address these challenges, we propose a model based on a Siamese network with squeeze attention (SSA) for incomplete multi-view multi-label classification (iMvMLC). Specifically, to capture the shared semantic information across different views, we combine cross-view collaborative synthesis (CCS) and viewwise representation calibration (VRC) mechanisms. CCS enhances the semantic interaction between views by introducing directive blocks and stacked autoencoders on top of the Siamese network, thereby improving the ability to extract shared semantic representations. The VRC mechanism uses contrastive learning with positive and negative sample pairs to refine the shared semantic space, ensuring higher feature consistency and better alignment across views. Furthermore, considering the task-specific importance variation exhibited by each view, we apply the squeeze attention-weighted fusion (SWF) strategy, which performs feature dimensionality reduction to amplify the key characteristics from each view and enables the model to flexibly adjust the influence of each perspective. Extensive evaluations conducted across five datasets demonstrate that the SSA method outperforms many existing approaches.
引用
收藏
页数:20
相关论文
共 50 条
[31]   Label Embedding for Multi-label Classification Via Dependence Maximization [J].
Li, Yachong ;
Yang, Youlong .
NEURAL PROCESSING LETTERS, 2020, 52 (02) :1651-1674
[32]   Incomplete multi-view learning: Review, analysis, and prospects [J].
Tang, Jingjing ;
Yi, Qingqing ;
Fu, Saiji ;
Tian, Yingjie .
APPLIED SOFT COMPUTING, 2024, 153
[33]   Suspicious Object Detection for Millimeter-Wave Images With Multi-View Fusion Siamese Network [J].
Guo, Dandan ;
Tian, Long ;
Du, Chuan ;
Xie, Pengfei ;
Chen, Bo ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :4088-4102
[34]   Flexible Directional Relations via Multi-Label Classification [J].
Long, Zhiguo ;
Peng, Junjie ;
Meng, Hua ;
Sioutis, Michael ;
Kou, Hui .
TRANSACTIONS IN GIS, 2025, 29 (02)
[35]   Robust Multi-Label Classification with Enhanced Global and Local Label Correlation [J].
Zhao, Tianna ;
Zhang, Yuanjian ;
Pedrycz, Witold .
MATHEMATICS, 2022, 10 (11)
[36]   Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification [J].
Chatterjee, Soumya ;
Maheshwari, Ayush ;
Ramakrishnan, Ganesh ;
Jagarlapudi, Saketha Nath .
16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, :2829-2841
[37]   Incomplete Multi-view Learning via Consensus Graph Completion [J].
Zhang, Heng ;
Chen, Xiaohong ;
Zhang, Enhao ;
Wang, Liping .
NEURAL PROCESSING LETTERS, 2023, 55 (04) :3923-3952
[38]   Incomplete Multi-view Learning via Consensus Graph Completion [J].
Heng Zhang ;
Xiaohong Chen ;
Enhao Zhang ;
Liping Wang .
Neural Processing Letters, 2023, 55 :3923-3952
[39]   Multi-view imputation and cross-attention network based on incomplete longitudinal and multimodal data for conversion prediction of mild cognitive impairment [J].
Wang, Tao ;
Chen, Xiumei ;
Zhang, Xiaoling ;
Zhou, Shuoling ;
Feng, Qianjin ;
Huang, Meiyan .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
[40]   Label Correlation Guided Deep Multi-View Image Annotation [J].
Xue, Zhe ;
Du, Junping ;
Zuo, Min ;
Li, Guorong ;
Huang, Qingming .
IEEE ACCESS, 2019, 7 :134707-134717