AFPNet: An adaptive frequency-domain optimized progressive medical image fusion network

被引:0
作者
Shao, Dangguo [1 ]
Yang, Hongjuan [1 ]
Ma, Lei [1 ]
Yi, Sanli [1 ]
机构
[1] KunmingUniv Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Yunnan, Peoples R China
关键词
Medical Image Fusion; Adaptive Frequency-Domain Optimization; Progressive Feature Fusion Strategy; Attention Convolutional Networks;
D O I
10.1016/j.bspc.2024.107357
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This study presents AFPNet, a novel Progressive Medical Image Fusion Network incorporating Adaptive Frequency-Domain Optimization, designed to enhance the fusion process of multi-modal medical imaging modalities, including SPECT-MRI and PET-MRI. AFPNet exploits a progressive Attention Convolutional Neural Network(ACNN) to significantly enhance the quality of fused medical images. Key innovations encompass a dual- branch module for efficient spatial and channel feature fusion, a Global Enhancement Attention Module for the seamless integration of global information, and a multi-scale feature fusion strategy to capture diverse contextual information. Experimental results on the test datasets indicate that AFPNet generally outperforms state-of-the-art approaches in key metrics such as Mutual Information (MI) and Visual Information Fidelity (VIF), showing notable improvements in preserving both structural coherence and fine-grained details. The incorporation of adaptive frequency-based weighting mechanisms within the model optimize fusion of high-frequency and low- frequency components, rendering it well-suited for medical imaging applications demanding exceptional precision.
引用
收藏
页数:18
相关论文
共 55 条
[1]   Single-Scale Fusion: An Effective Approach to Merging Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
De Vleeschouwer, Christophe ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (01) :65-78
[2]   Curvelet Transform-based volume fusion for correcting signal loss artifacts in Time-of-Flight Magnetic Resonance Angiography data [J].
Baghaie, Ahmadreza ;
Schnell, Susanne ;
Bakhshinejad, Ali ;
Fathi, Mojtaba F. ;
D'Souza, Roshan M. ;
Rayz, Vitaliy L. .
COMPUTERS IN BIOLOGY AND MEDICINE, 2018, 99 :142-153
[3]   THE FOURIER-TRANSFORM [J].
BRACEWELL, RN .
SCIENTIFIC AMERICAN, 1989, 260 (06) :86-&
[4]   Image Fusion Using Quaternion Wavelet Transform and Multiple Features [J].
Chai, Pengfei ;
Luo, Xiaoqing ;
Zhang, Zhancheng .
IEEE ACCESS, 2017, 5 :6724-6734
[5]   Infrared and visible image fusion using a generative adversarial network with a dual-branch generator and matched dense blocks [J].
Guo, Li ;
Tang, Dandan .
SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) :1811-1819
[6]  
Heckbert P., 1995, Comput Graphics, V2, P15
[7]   Unsupervised domain adaptation for cross-modality liver segmentation via joint adversarial learning and self-learning [J].
Hong, Jin ;
Yu, Simon Chun-Ho ;
Chen, Weitian .
APPLIED SOFT COMPUTING, 2022, 121
[8]   Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation [J].
Hong, Jin ;
Zhang, Yu-Dong ;
Chen, Weitian .
KNOWLEDGE-BASED SYSTEMS, 2022, 250
[9]   MGMDcGAN: Medical Image Fusion Using Multi-Generator Multi-Discriminator Conditional Generative Adversarial Network [J].
Huang, Jun ;
Le, Zhuliang ;
Ma, Yong ;
Fan, Fan ;
Zhang, Hao ;
Yang, Lei .
IEEE ACCESS, 2020, 8 :55145-55157
[10]   Evaluation of focus measures in multi-focus image fusion [J].
Huang, Wei ;
Jing, Zhongliang .
PATTERN RECOGNITION LETTERS, 2007, 28 (04) :493-500