Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

被引:2
|
作者
Feng, Bin [1 ]
Ai, Chengbo [1 ]
Zhang, Haofei [2 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] 208 Res Inst China Ordnance Ind, Beijing 102202, Peoples R China
关键词
pulse coupled neural network; infrared and visible light images; image fusion; non-subsampled shearlet transform; PERFORMANCE; PCNN;
D O I
10.3390/electronics13122337
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The pulse-coupled neural network (PCNN), due to its effectiveness in simulating the mammalian visual system to perceive and understand visual information, has been widely applied in the fields of image segmentation and image fusion. To address the issues of low contrast and the loss of detail information in infrared and visible light image fusion, this paper proposes a novel image fusion method based on an improved adaptive dual-channel PCNN model in the non-subsampled shearlet transform (NSST) domain. Firstly, NSST is used to decompose the infrared and visible light images into a series of high-pass sub-bands and a low-pass sub-band, respectively. Next, the PCNN models are stimulated using the weighted sum of the eight-neighborhood Laplacian of the high-pass sub-bands and the energy activity of the low-pass sub-band. The high-pass sub-bands are fused using local structural information as the basis for the linking strength for the PCNN, while the low-pass sub-band is fused using a linking strength based on multiscale morphological gradients. Finally, the fused high-pass and low-pass sub-bands are reconstructed to obtain the fused image. Comparative experiments demonstrate that, subjectively, this method effectively enhances the contrast of scenes and targets while preserving the detail information of the source images. Compared to the best mean values of the objective evaluation metrics of the compared methods, the proposed method shows improvements of 2.35%, 3.49%, and 11.60% in information entropy, mutual information, and standard deviation, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Image fusion method based on adaptive pulse coupled neural network in the discrete fractional random transform domain
    Lang, Jun
    Hao, Zhengchao
    OPTIK, 2015, 126 (23): : 3644 - 3651
  • [42] Infrared and Visible Image Fusion via Sparse Representation and Adaptive Dual-Channel PCNN Model Based on Co-Occurrence Analysis Shearlet Transform
    Qi, Biao
    Li, Qiang
    Zhang, Yu
    Zhao, Qinglei
    Qiao, Bingxiang
    Shi, Junxia
    Lv, Zengming
    Li, Guoning
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [43] A novel fusion framework of visible light and infrared images based on singular value decomposition and adaptive DUAL-PCNN in NSST domain
    Cheng, Boyang
    Jin, Longxu
    Li, Guoning
    INFRARED PHYSICS & TECHNOLOGY, 2018, 91 : 153 - 163
  • [44] A dual-path residual attention fusion network for infrared and visible images
    Zhishe Wang
    Yang F.
    Wang J.
    Xu J.
    Yang F.
    Ji L.
    Optik, 2023, 290
  • [45] An improved hybrid multiscale fusion algorithm based on NSST for infrared-visible images
    Hu, Peng
    Wang, Chenjun
    Li, Dequan
    Zhao, Xin
    VISUAL COMPUTER, 2023,
  • [46] Memristor-based multi-channel pulse coupled neural network for image fusion
    Jian L.
    Chengmao W.
    Xiaoping T.
    Journal of China Universities of Posts and Telecommunications, 2020, 27 (06): : 54 - 72
  • [47] A Novel Fusion Algorithm for Visible and Infrared Image using Non-subsampled Contourlet Transform and Pulse-coupled Neural Network
    Ikuta, Chihiro
    Zhang, Songjun
    Uwate, Yoko
    Yang, Guoan
    Nishio, Yoshifumi
    PROCEEDINGS OF THE 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS (VISAPP), VOL 1, 2014, : 160 - 164
  • [48] Multimodal image sensor fusion in a cascaded framework using optimized dual channel pulse coupled neural network
    Manisha Das
    Deep Gupta
    Petia Radeva
    Ashwini M. Bakde
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 11985 - 12004
  • [49] Medical images segmentation based on improved three-dimensional pulse coupled neural network
    Wang M.
    Xu X.
    Wang G.
    Ding S.
    Sun T.
    International Journal of Wireless and Mobile Computing, 2017, 13 (01) : 72 - 77
  • [50] Infrared Image Mosaic Based on Pulse Coupled Neural Network
    Zhang, Xuewu
    Wang, Yan
    Li, Wei
    Zhou, Yun
    INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY, PTS 1-4, 2013, 263-266 : 2493 - 2497