ACL-Net: Attribute-Aware Contrastive Learning Network for Medical Image Fusion

被引:0
作者
Liu, Yanyu [1 ,2 ]
Hou, Ruichao [3 ]
Ding, Zhaisheng [4 ]
Zhou, Dongming [5 ]
Cao, Jinde [6 ]
机构
[1] Yunnan Univ Finance & Econ, Sch Logist & Management Engn, Kunming 650221, Peoples R China
[2] Yunnan Univ Finance & Econ, Yunnan Key Lab Serv Comp, Kunming 650221, Peoples R China
[3] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[4] Jiangsu Normal Univ, Sch Elect Engn & Automat, Xuzhou 221116, Peoples R China
[5] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650504, Peoples R China
[6] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Contrastive learning; Magnetic resonance imaging; Transforms; Transformers; Training; Medical diagnostic imaging; Electronic mail; Decoding; Feature extraction; medical image fusion; pixel intensity and structure transfer; FRAMEWORK;
D O I
10.1109/LSP.2025.3577945
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Medical image fusion aims to integrate multi-sensor source images into a unified representation, providing comprehensive and diagnostically enriched information to support clinical decision-making. However, the scarcity of labeled data presents significant challenges in effectively learning complementary features across modalities. In this paper, we propose a novel attribute-aware contrastive learning network, called ACL-Net, boosting medical image fusion performance. Specifically, we introduce the attribute transformation strategy to simulate variations in pixel intensity and structural patterns, guiding the model to focus on critical cross-modal information. In this way, it enhances contrastive learning by generating diverse negative pairs, thereby mitigating the scarcity of negative samples in unsupervised fusion scenarios. Extensive experiments demonstrate that our method achieves superior performance compared to state-of-the-art medical image fusion methods.
引用
收藏
页码:2484 / 2488
页数:5
相关论文
共 33 条
[11]   CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion [J].
Liu, Jinyuan ;
Lin, Runjia ;
Wu, Guanyao ;
Liu, Risheng ;
Luo, Zhongxuan ;
Fan, Xin .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (05) :1748-1775
[12]   Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection [J].
Liu, Jinyuan ;
Fan, Xin ;
Huang, Zhanbo ;
Wu, Guanyao ;
Liu, Risheng ;
Zhong, Wei ;
Luo, Zhongxuan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5792-5801
[13]   Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion [J].
Liu, Risheng ;
Liu, Zhu ;
Liu, Jinyuan ;
Fan, Xin .
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, :1600-1608
[14]   An Improved Hybrid Network With a Transformer Module for Medical Image Fusion [J].
Liu, Yanyu ;
Zang, Yongsheng ;
Zhou, Dongming ;
Cao, Jinde ;
Nie, Rencan ;
Hou, Ruichao ;
Ding, Zhaisheng ;
Mei, Jiatian .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (07) :3489-3500
[15]   Medical Image Fusion via Convolutional Sparsity Based Morphological Component Analysis [J].
Liu, Yu ;
Chen, Xun ;
Ward, Rabab K. ;
Wang, Z. Jane .
IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (03) :485-489
[16]  
Liu Y, 2017, 2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), P1070
[17]   A general framework for image fusion based on multi-scale transform and sparse representation [J].
Liu, Yu ;
Liu, Shuping ;
Wang, Zengfu .
INFORMATION FUSION, 2015, 24 :147-164
[18]   SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer [J].
Ma, Jiayi ;
Tang, Linfeng ;
Fan, Fan ;
Huang, Jun ;
Mei, Xiaoguang ;
Ma, Yong .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (07) :1200-1217
[19]   DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion [J].
Ma, Jiayi ;
Xu, Han ;
Jiang, Junjun ;
Mei, Xiaoguang ;
Zhang, Xiao-Ping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4980-4995
[20]   Infrared and visible image fusion via detail preserving adversarial learning [J].
Ma, Jiayi ;
Liang, Pengwei ;
Yu, Wei ;
Chen, Chen ;
Guo, Xiaojie ;
Wu, Jia ;
Jiang, Junjun .
INFORMATION FUSION, 2020, 54 :85-98