Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

被引:2
|
作者
Feng, Bin [1 ]
Ai, Chengbo [1 ]
Zhang, Haofei [2 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] 208 Res Inst China Ordnance Ind, Beijing 102202, Peoples R China
关键词
pulse coupled neural network; infrared and visible light images; image fusion; non-subsampled shearlet transform; PERFORMANCE; PCNN;
D O I
10.3390/electronics13122337
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The pulse-coupled neural network (PCNN), due to its effectiveness in simulating the mammalian visual system to perceive and understand visual information, has been widely applied in the fields of image segmentation and image fusion. To address the issues of low contrast and the loss of detail information in infrared and visible light image fusion, this paper proposes a novel image fusion method based on an improved adaptive dual-channel PCNN model in the non-subsampled shearlet transform (NSST) domain. Firstly, NSST is used to decompose the infrared and visible light images into a series of high-pass sub-bands and a low-pass sub-band, respectively. Next, the PCNN models are stimulated using the weighted sum of the eight-neighborhood Laplacian of the high-pass sub-bands and the energy activity of the low-pass sub-band. The high-pass sub-bands are fused using local structural information as the basis for the linking strength for the PCNN, while the low-pass sub-band is fused using a linking strength based on multiscale morphological gradients. Finally, the fused high-pass and low-pass sub-bands are reconstructed to obtain the fused image. Comparative experiments demonstrate that, subjectively, this method effectively enhances the contrast of scenes and targets while preserving the detail information of the source images. Compared to the best mean values of the objective evaluation metrics of the compared methods, the proposed method shows improvements of 2.35%, 3.49%, and 11.60% in information entropy, mutual information, and standard deviation, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Adaptive image fusion algorithm for infrared and visible light images based on DT-CWT
    Yang Xiao-Hui
    Jin Hai-Yan
    Jiao Li-Cheng
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2007, 26 (06) : 419 - 424
  • [32] An Improved Fusion Method of Infrared and Visible Images Based on FusionGAN
    Yao, Zhiqiang
    Guo, Huinan
    Ren, Long
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [33] Novel fusion method for visible light and infrared images based on NSST-SF-PCNN
    Kong, Weiwei
    Zhang, Longjun
    Lei, Yang
    INFRARED PHYSICS & TECHNOLOGY, 2014, 65 : 103 - 112
  • [34] Fusion of Infrared and Visible Light Images Based on Region Segmentation
    Liu Kun
    Guo Lei
    Li Huihui
    Chen Jingsong
    CHINESE JOURNAL OF AERONAUTICS, 2009, 22 (01) : 75 - 80
  • [35] Fusion of Infrared and Visible Light Images Based on Compressive Sensing
    Wu, Yanhai
    Zhang, Ye
    Wu, Nan
    Wang, Jing
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCES IN MECHANICAL ENGINEERING AND INDUSTRIAL INFORMATICS, 2015, 15 : 1268 - 1273
  • [36] Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN
    Xie, Qiyue
    Ma, Lin
    Guo, Ziqi
    Fu, Qiang
    Shen, Zhongli
    Wang, Xiaoli
    INFRARED PHYSICS & TECHNOLOGY, 2023, 131
  • [37] Infrared and Visible Image Fusion Based on Significant Matrix and Neural Network
    Shen Yu
    Chen Xiaopeng
    Yuan Yubin
    Wang Lin
    Zhang Hongguo
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (20)
  • [38] Adaptive fusion framework of infrared and visual image using saliency detection and improved dual-channel PCNN in the LNSST domain
    Cheng, Boyang
    Jin, Longxu
    Li, Guoning
    INFRARED PHYSICS & TECHNOLOGY, 2018, 92 : 30 - 43
  • [39] Fusion method for infrared and visible images based on improved quantum theory model
    Kong, Weiwei
    Lei, Yang
    Ren, Minmin
    NEUROCOMPUTING, 2016, 212 : 12 - 21
  • [40] Fusion of Medical Images Using Adaptive Pulse Coupled Neural Networks Based on QCSA Optimization
    Kavita, Pydi
    Alli, Daisy Rani
    Rao, Annepu Bhujanga
    BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2021, 14 (05): : 182 - 189