Enhanced multimodal medical image fusion via modified DWT with arithmetic optimization algorithm

被引:6
作者
Alzahrani, Ahmad A. [1 ]
机构
[1] King Abdulaziz Univ, Fac Comp & Informat Technol, Jeddah 21589, Saudi Arabia
关键词
Medical images; Multimodality; Image fusion; Arithmetic optimization algorithm; Fusion rule;
D O I
10.1038/s41598-024-69997-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Medical image fusion (MIF) techniques are proficient in combining medical images in distinct morphologies to obtain a reliable medical analysis. A single modality image could not offer adequate data for an accurate analysis. Therefore, a novel multimodal MIF-based artificial intelligence (AI) method has been presented. MIF approaches fuse multimodal medical images for exact and reliable medical recognition. Multimodal MIF improves diagnostic accuracy and clinical decision-making by combining complementary data in different imaging modalities. This article presents a new multimodal medical image fusion model utilizing Modified DWT with an Arithmetic Optimization Algorithm (MMIF-MDWTAOA) approach. The MMIF-MDWTAOA approach aims to generate a fused image with the significant details and features from each modality, leading to an elaborated depiction for precise interpretation by medical experts. The bilateral filtering (BF) approach is primarily employed for noise elimination. Next, the image decomposition process uses a modified discrete wavelet transform (MDWT) approach. However, the approximation coefficient of modality_1 and the detailed coefficient of modality_2 can be fused interchangeably. Furthermore, a fusion rule is derived from combining the multimodality data, and the AOA model is enforced to ensure the optimum selection of the fusion rule parameters. A sequence of simulations is accomplished to validate the enhanced output of the MMIF-MDWTAOA technique. The investigational validation of the MMIF-MDWTAOA technique showed the highest entropy values of 7.568 and 7.741 bits/pixel over other approaches.
引用
收藏
页数:15
相关论文
共 25 条
[1]  
Adjei-Mensah Isaac, 2021, 2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), P179, DOI 10.1109/ICCWAMTIP53232.2021.9674065
[2]   Artificial Intelligence-Based Multimodal Medical Image Fusion Using Hybrid S2 Optimal CNN [J].
Almasri, Marwah Mohammad ;
Alajlan, Abrar Mohammed .
ELECTRONICS, 2022, 11 (14)
[3]   Impact of Iterative Bilateral Filtering on the Noise Power Spectrum of Computed Tomography Images [J].
Anam, Choirul ;
Naufal, Ariij ;
Sutanto, Heri ;
Adi, Kusworo ;
Dougherty, Geoff .
ALGORITHMS, 2022, 15 (10)
[4]   MRI and CT image fusion using cartoon-texture and QWT decomposition and cuckoo search-grey wolf optimization [J].
Babu, B. Suresh ;
Venkatanarayana, M. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) :8797-8835
[5]   Two stage multi-modal medical image fusion with marine predator algorithm-based cascaded optimal DTCWT and NSST with deep learning [J].
Babu, B. Suresh ;
Narayana, M. Venkata .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
[6]   Feature extraction of multimodal medical image fusion using novel deep learning and contrast enhancement method [J].
Bhutto, Jameel Ahmed ;
Jiang, Guosong ;
Rahman, Ziaur ;
Ishfaq, Muhammad ;
Sun, Zhengzheng ;
Soomro, Toufique Ahmed .
APPLIED INTELLIGENCE, 2024, 54 (07) :5907-5930
[7]   ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis [J].
Dalmaz, Onat ;
Yurt, Mahmut ;
Cukur, Tolga .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (10) :2598-2614
[8]   SwinBTS: A Method for 3D Multimodal Brain Tumor Segmentation Using Swin Transformer [J].
Jiang, Yun ;
Zhang, Yuan ;
Lin, Xin ;
Dong, Jinkun ;
Cheng, Tongtong ;
Liang, Jing .
BRAIN SCIENCES, 2022, 12 (06)
[9]   DFENet: A dual-branch feature enhanced network integrating transformers and convolutional feature learning for multimodal medical image fusion [J].
Li, Weisheng ;
Zhang, Yin ;
Wang, Guofen ;
Huang, Yuping ;
Li, Ruyue .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 80
[10]   An Improved Hybrid Network With a Transformer Module for Medical Image Fusion [J].
Liu, Yanyu ;
Zang, Yongsheng ;
Zhou, Dongming ;
Cao, Jinde ;
Nie, Rencan ;
Hou, Ruichao ;
Ding, Zhaisheng ;
Mei, Jiatian .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (07) :3489-3500