Infrared and Visible Images Fusion Algorithm Based on NSST and IFCNN

被引:0
|
作者
Yang Yanchun [1 ]
Gao Xiaoyu [1 ]
Dang Jianwu [1 ]
Wang Yangping [1 ]
机构
[1] Lanzhou Jiaotong Univ, Sch Elect & Informat Engn, Lanzhou 730070, Gansu, Peoples R China
关键词
image processing; non-subsampled shearlet transform; infrared and visible images; convolutional neural network; image fusion;
D O I
10.3788/LOP202158.2010004
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Aiming at the problem of insufficient edge detail preservation in image fusion, infrared and visible images fusion algorithm based on non-subsampled shear-wave transform (NSST) and convolutional neural network image fusion framework (IFCNN) is proposed. First, infrared and visible images are decomposed by NSST. Then, in order to make the low frequency sub band image better highlight the contour information, the image is fused using similarity matching fusion rule ; for the high-frequency sub band images, the feature layers are extracted using IFCNN, and the maximum weight image of feature layer can be obtained through L-2 regularization, convolution operation, and maximum selection strategy processing, and the high frequency fusion rule can be determined according to the maximum weight image. Finally, the NSST inverse transform is used to obtain the final fusion image. The experimental results show that the proposed algorithm retains the details of image edges and textures, reduces artifacts and noises, and has good visual effects.
引用
收藏
页数:9
相关论文
共 25 条
  • [1] Ensemble of CNN for multi-focus image fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    [J]. INFORMATION FUSION, 2019, 51 : 201 - 214
  • [2] [Anonymous], 2015, IMAGE FUSION TECHNOL
  • [3] [包观笑 Bao Guanxiao], 2016, [包装工程, Packaging Engineering], V37, P130
  • [4] Sparse directional image representations using the discrete shearlet transform
    Easley, Glenn
    Labate, Demetrio
    Lim, Wang-Q
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2008, 25 (01) : 25 - 46
  • [5] Infrared and Visible Image Fusion Method Based on Convolutional Auto-Encoder and Residual Block
    Jiang Zetao
    He Yuting
    [J]. ACTA OPTICA SINICA, 2019, 39 (10)
  • [6] Infrared and Visible Image Fusion Algorithm Based on Improved Guided Filtering and Dual-Channel Spiking Cortical Model
    Jiang Zetao
    Wu Hui
    Zhou Xiaoling
    [J]. ACTA OPTICA SINICA, 2018, 38 (02)
  • [7] Technique for infrared and visible image fusion based on non-subsampled shearlet transform and spiking cortical model
    Kong, Weiwei
    Wang, Binghe
    Lei, Yang
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2015, 71 : 87 - 98
  • [8] Technique for image fusion based on NSST domain INMF
    Kong, Weiwei
    [J]. OPTIK, 2014, 125 (11): : 2716 - 2722
  • [9] Pixel- and region-based image fusion with complex wavelets
    Lewis, John J.
    O'Callaghan, Robert J.
    Nikolov, Stavri G.
    Bull, David R.
    Canagarajah, Nishan
    [J]. INFORMATION FUSION, 2007, 8 (02) : 119 - 130
  • [10] Liang L Z, 2016, J SOFTWARE ENG, V1910, P34