MAAFusion: A Multimodal Medical Image Fusion Network Via Arbitrary Kernel Convolution And Attention Mechanism

被引:0
作者
Wang, Wenqing [1 ]
He, Ji [1 ]
Li, Lingzhou [1 ]
机构
[1] Xian Univ Technol, Xian, Peoples R China
来源
2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024 | 2024年
基金
中国国家自然科学基金;
关键词
Medical image fusion; Channel prior convolutional attention; Deep learning;
D O I
10.1145/3663976.3664230
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This study introduces an advanced multimodal medical image fusion technique that overcomes the limitations of traditional CNN-based approaches and attention mechanisms, which often result in computational redundancy and overlook critical channel-specific features. Our innovative dual-branch attention fusion network utilizes Arbitrary Kernel Convolution (AKConv) for efficient feature aggregation and minimizes unnecessary computations. Additionally, the Channel Prior Convolutional Attention (CPCA) module improves the discrimination of salient channel features, enhancing overall feature extraction. The Lightweight Convolutional Module (LCM) further enhances the feature extraction process while reducing the computational load by integrating dynamic gating mechanisms with deep separable convolution. Experimental results confirm the superior performance of our framework in both quantitative and qualitative assessments compared to existing fusion methods.
引用
收藏
页数:5
相关论文
共 16 条
[1]   MUFusion: A general unsupervised image fusion network based on memory unit [J].
Cheng, Chunyang ;
Xu, Tianyang ;
Wu, Xiao-Jun .
INFORMATION FUSION, 2023, 92 :80-92
[2]  
Huang HJ, 2023, Arxiv, DOI arXiv:2306.05196
[3]   Multimodal medical image fusion towards future research: A review [J].
Khan, Sajid Ullah ;
Khan, Mir Ahmad ;
Azhar, Muhammad ;
Khan, Faheem ;
Lee, Youngmoon ;
Javed, Muhammad .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (08)
[4]   DenseFuse: A Fusion Approach to Infrared and Visible Images [J].
Li, Hui ;
Wu, Xiao-Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2614-2623
[5]  
Li HL, 2024, Arxiv, DOI arXiv:2206.02424
[6]   A multiscale double-branch residual attention network for anatomical-functional medical image fusion [J].
Li, Weisheng ;
Peng, Xiuxiu ;
Fu, Jun ;
Wang, Guofen ;
Huang, Yuping ;
Chao, Feifei .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 141
[7]   DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion [J].
Ma, Jiayi ;
Xu, Han ;
Jiang, Junjun ;
Mei, Xiaoguang ;
Zhang, Xiao-Ping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4980-4995
[8]  
Qu LH, 2022, Arxiv, DOI arXiv:2201.07451
[9]  
Rajalingam B, 2018, Intl Journal of Sci Res in Comp Sci App., V7, P1
[10]   MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer [J].
Tang, Wei ;
He, Fazhi ;
Liu, Yu ;
Duan, Yansong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :5134-5149