Medical image fusion based on modified pulse coupled neural network model and kirsch operator

被引:2
作者
Wang, Guofen [1 ]
Huang, Yongdong [1 ,2 ]
机构
[1] North Minzu Univ, Inst Image Proc & Understanding, Yinchuan 750021, Peoples R China
[2] Dalian Minzu Univ, Ctr Math & Informat Sci, Dalian 116600, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonsubsampled shearlet transform; kirsch operator; novel sum-modified-Laplacian gradient domain guided image filtering; modified pulse coupled neural network; MINIMIZATION SMOOTHING FILTER; TRANSFORM;
D O I
10.1142/S0219691319500528
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The medical image fusion process integrates the information of multiple source images into a single image. This fused image can provide more comprehensive information and is helpful in clinical diagnosis and treatment. In this paper, a new medical image fusion algorithm is proposed. Firstly, the original image is decomposed into a low-frequency sub-band and a series of high-frequency sub-bands by using nonsubsampled shearlet transform (NSST). For the low-frequency sub-band, kirsch operator is used to extract the directional feature maps from eight directions and novel sum-modified-Laplacian (NSML) method is used to calculate the significant information of each directional feature map, and then, combining a sigmod function and the significant information updated by gradient domain guided image filtering (GDGF), calculate the fusion weight coefficients of the directional feature maps. The fused feature map is obtained by summing the convolutions of the weight coefficients and the directional feature maps. The final fused low-frequency sub-band is obtained by the linear combination of the eight fused directional feature maps. The modified pulse coupled neural network (MPCNN) model is used to calculate the firing times of each high-frequency sub-band coefficient, and the fused high-frequency sub-bands are selected according to the firing times. Finally, the inverse NSST acts on the fused low-frequency sub-band and the fused high-frequency sub-bands to obtain the fused image. The experimental results show that the proposed medical image fusion algorithm expresses some advantages over the classical medical image fusion algorithms in objective and subjective evaluation.
引用
收藏
页数:21
相关论文
共 50 条
[41]   A Progressive Implicit Neural Fusion Network for Multispectral Image Pansharpening [J].
Feng, Yao ;
Zhang, Long ;
Zhang, Yingwei ;
Guo, Xinguo ;
Xie, Guangqi ;
Liu, Chuang ;
Xiang, Shao .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :14935-14948
[42]   Infrared and visible image fusion with supervised convolutional neural network [J].
An, Wen-Bo ;
Wang, Hong-Mei .
OPTIK, 2020, 219
[43]   Remote Sensing Image Fusion With Deep Convolutional Neural Network [J].
Shao, Zhenfeng ;
Cai, Jiajun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) :1656-1669
[44]   An ensemble deep learning model for medical image fusion with Siamese neural networks and VGG-19 [J].
Allapakam, Venu ;
Karuna, Yepuganti .
PLOS ONE, 2024, 19 (10)
[45]   3D shape reconstruction from multifocus image fusion using a multidirectional modified Laplacian operator [J].
Yan, Tao ;
Hu, Zhiguo ;
Qian, Yuhua ;
Qiao, Zhiwei ;
Zhang, Linyuan .
PATTERN RECOGNITION, 2020, 98
[46]   MMFGAN: A novel multimodal brain medical image fusion based on the improvement of generative adversarial network [J].
Guo, Kai ;
Hu, Xiaohan ;
Li, Xiongfei .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) :5889-5927
[47]   Medical image fusion method based on dense block and deep convolutional generative adversarial network [J].
Zhao, Cheng ;
Wang, Tianfu ;
Lei, Baiying .
NEURAL COMPUTING & APPLICATIONS, 2021, 33 (12) :6595-6610
[48]   Multimodal Medical Image Fusion Based on Hybrid Bilateral Filter and Contrast Adjustment Model [J].
Zhang, Yingmei ;
Lee, Hyo Jong .
2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, :1653-1656
[49]   A Remote Sensing Image Fusion Method Combining Low-Level Visual Features and Parameter-Adaptive Dual-Channel Pulse-Coupled Neural Network [J].
Hou, Zhaoyang ;
Lv, Kaiyun ;
Gong, Xunqiang ;
Wan, Yuting .
REMOTE SENSING, 2023, 15 (02)
[50]   Remote Sensing Image Reconstruction Method Based on Parameter Adaptive Dual-Channel Pulse-Coupled Neural Network to Optimize Multiscale Decomposition [J].
Hu, Pengcheng ;
Tang, Shihua ;
Zhang, Yan ;
Song, Xiaohui ;
Sun, Mengbo .
IEEE ACCESS, 2023, 11 :78084-78103