AFPNet: An adaptive frequency-domain optimized progressive medical image fusion network

被引:0
作者
Shao, Dangguo [1 ]
Yang, Hongjuan [1 ]
Ma, Lei [1 ]
Yi, Sanli [1 ]
机构
[1] KunmingUniv Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Yunnan, Peoples R China
关键词
Medical Image Fusion; Adaptive Frequency-Domain Optimization; Progressive Feature Fusion Strategy; Attention Convolutional Networks;
D O I
10.1016/j.bspc.2024.107357
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This study presents AFPNet, a novel Progressive Medical Image Fusion Network incorporating Adaptive Frequency-Domain Optimization, designed to enhance the fusion process of multi-modal medical imaging modalities, including SPECT-MRI and PET-MRI. AFPNet exploits a progressive Attention Convolutional Neural Network(ACNN) to significantly enhance the quality of fused medical images. Key innovations encompass a dual- branch module for efficient spatial and channel feature fusion, a Global Enhancement Attention Module for the seamless integration of global information, and a multi-scale feature fusion strategy to capture diverse contextual information. Experimental results on the test datasets indicate that AFPNet generally outperforms state-of-the-art approaches in key metrics such as Mutual Information (MI) and Visual Information Fidelity (VIF), showing notable improvements in preserving both structural coherence and fine-grained details. The incorporation of adaptive frequency-based weighting mechanisms within the model optimize fusion of high-frequency and low- frequency components, rendering it well-suited for medical imaging applications demanding exceptional precision.
引用
收藏
页数:18
相关论文
共 55 条
[11]   ReCoNet: Recurrent Correction Network for Fast and Efficient Multi-modality Image Fusion [J].
Huang, Zhanbo ;
Liu, Jinyuan ;
Fan, Xin ;
Liu, Risheng ;
Zhong, Wei ;
Luo, Zhongxuan .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :539-555
[12]   Structured Receptive Fields in CNNs [J].
Jacobsen, Jorn-Henrik ;
van Gemert, Jan ;
Lou, Zhongyou ;
Smeulders, Arnold W. M. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2610-2619
[13]   Medical image fusion: A survey of the state of the art [J].
James, Alex Pappachen ;
Dasarathy, Belur V. .
INFORMATION FUSION, 2014, 19 :4-19
[14]   SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion [J].
Jian, Lihua ;
Yang, Xiaomin ;
Liu, Zheng ;
Jeon, Gwanggil ;
Gao, Mingliang ;
Chisholm, David .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[15]  
Kavita P., 2022, Int. J. Cognit. Comput. Eng., V3, P136, DOI [10.1016/j.ijcce.2022.05.002, DOI 10.1016/J.IJCCE.2022.01.012]
[16]   DYNAMIC MEASUREMENT OF COMPUTER GENERATED IMAGE SEGMENTATIONS [J].
LEVINE, MD ;
NAZIF, AM .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1985, 7 (02) :155-164
[17]   PET and MRI image fusion based on a dense convolutional network with dual attention [J].
Li, Bicao ;
Hwang, Jenq-Neng ;
Liu, Zhoufeng ;
Li, Chunlei ;
Wang, Zongmin .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 151
[18]   Source-free unsupervised adaptive segmentation for knee joint MRI [J].
Li, Siyue ;
Zhao, Shutian ;
Zhang, Yudong ;
Hong, Jin ;
Chen, Weitian .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 92
[19]   A multiscale double-branch residual attention network for anatomical-functional medical image fusion [J].
Li, Weisheng ;
Peng, Xiuxiu ;
Fu, Jun ;
Wang, Guofen ;
Huang, Yuping ;
Chao, Feifei .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 141
[20]   Deep Learning Attention Mechanism in Medical Image Analysis: Basics and Beyonds [J].
Li, Xiang ;
Li, Minglei ;
Yan, Pengfei ;
Li, Guanyi ;
Jiang, Yuchen ;
Luo, Hao ;
Yin, Shen .
INTERNATIONAL JOURNAL OF NETWORK DYNAMICS AND INTELLIGENCE, 2023, 2 (01) :93-116