Multimodal medical image fusion algorithm based on pulse coupled neural networks and nonsubsampled contourlet transform

被引:23
作者
Ibrahim, Sa I. [1 ]
Makhlouf, M. A. [1 ]
El-Tawel, Gh S. [2 ]
机构
[1] Suez Canal Univ, Fac Comp & Informat, Informat Syst Dept, Ismailia, Egypt
[2] Suez Canal Univ, Fac Comp & Informat, Comp Sci Dept, Ismailia, Egypt
关键词
Medical image fusion; Pulse coupled neural networks; Nonsubsampled contourlet transform; Computed tomography; Magnetic resonance image; CT;
D O I
10.1007/s11517-022-02697-8
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Combining two medical images from different modalities is more helpful for using the resulting image in the healthcare field. Medical image fusion means combining two or more images coming from multiple sensors. This technology obtains an output image that presents more effective and useful information from two images. This paper proposes a multi-modal medical image fusion algorithm based on the nonsubsampled contourlet transform (NSCT) and pulse coupled neural networks (PCNN) methods. The input images are decomposed using the NSCT method into low- and high-frequency subbands. The PCNN is a fusion rule for integrating both low- and high-frequency subbands. The inverse of the NSCT method is to reconstruct the fused image. The results of medical image fusion help doctors with disease diagnosis and patient treatment. The proposed algorithm is tested on six groups of multi-modal medical images using 100 pairs of input images. The proposed algorithm is compared with eight fusion methods. We evaluate the performance of the proposed algorithm using the fusion metrics: peak signal to noise ratio (PSNR), mutual information (MI), entropy (EN), weighted edge information (Q(AB/F)), nonlinear correlation information entropy (Q(ncie)), standard deviation (SD), and average gradient (AG). Experimental results show that the proposed algorithm can perform better than other medical image fusion methods and achieve promising results.
引用
收藏
页码:155 / 177
页数:23
相关论文
共 32 条
[1]   Fusion of MRI and CT images using guided image filter and image statistics [J].
Bavirisetti, Durga Prasad ;
Kollu, Vijayakumar ;
Gang, Xiao ;
Dhuli, Ravindra .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2017, 27 (03) :227-237
[2]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[3]   Brain Medical Image Fusion Based on Dual-Branch CNNs in NSST Domain [J].
Ding, Zhaisheng ;
Zhou, Dongming ;
Nie, Rencan ;
Hou, Ruichao ;
Liu, Yanyu .
BIOMED RESEARCH INTERNATIONAL, 2020, 2020
[4]   Union Laplacian pyramid with multiple features for medical image fusion [J].
Du, Jiao ;
Li, Weisheng ;
Xiao, Bin ;
Nawaz, Qamar .
NEUROCOMPUTING, 2016, 194 :326-339
[5]   Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex [J].
Eckhorn, R. ;
Reitboeck, H. J. ;
Arndt, M. ;
Dicke, P. .
NEURAL COMPUTATION, 1990, 2 (03) :293-307
[6]   CT and MR Image Fusion Scheme in Nonsubsampled Contourlet Transform Domain [J].
Ganasala, Padma ;
Kumar, Vinod .
JOURNAL OF DIGITAL IMAGING, 2014, 27 (03) :407-418
[7]  
Gomathi P.S., 2016, CIRCUITS SYST, V7, P1598, DOI [10.4236/cs.2016.78139, DOI 10.4236/CS.2016.78139]
[8]  
Gong JM, 2016, INT SYM COMPUT INTEL, P28, DOI [10.1109/ISCID.2016.14, 10.1109/ISCID.2016.1015]
[9]   Medical image fusion: A survey of the state of the art [J].
James, Alex Pappachen ;
Dasarathy, Belur V. .
INFORMATION FUSION, 2014, 19 :4-19
[10]   Image Fusion Techniques: A Survey [J].
Kaur, Harpreet ;
Koundal, Deepika ;
Kadyan, Virender .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2021, 28 (07) :4425-4447