Infrared and visible light image fusion via pixel mean shift and source image gradient

被引:5
作者
Dong, Linlu [1 ]
Wang, Jun [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Sichuan, Peoples R China
关键词
Image fusion; Infrared image; Visible-light image; Detail preserving; Multiscale decomposition; INVARIANT SHEARLET TRANSFORM; ALGORITHM; MODEL; NETWORK; PCNN;
D O I
10.1016/j.infrared.2023.104767
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Image fusion is performed to merge the information of different source images into one image. In this study, a fusion algorithm based on the pixel mean shift and source image gradient was proposed to make the background of the fused image clear and the target prominent. First, a pixel spatial average kernel function was designed to separate the image texture and the significant target during pixel density migration. In this study, a novel approach is presented that distinguishes itself from other methods in two distinct ways. Firstly, it segregates the texture details of dissimilar pixel regions and captures the texture characteristics of analogous pixel regions. Secondly, by utilizing the discrepancy between the minimum and maximum values of infrared and visible images, the proposed technique incorporates the source graph into the fusion process, thereby improving the precision of the information. Additionally, the feature reconstruction function was designed based on the layer features, which could adaptively concentrate the source image information on one image and further improve the clarity and information retention of the fused image. Finally, the results of the qualitative and quantitative comparison of our proposed method with other state-of-the-art methods available, obtained by applying them to public datasets, demonstrated the advantages of our algorithm. Our results retained more appearance details and significantly more target information.
引用
收藏
页数:19
相关论文
共 46 条
  • [1] Multifocus image fusion using modified pulse coupled neural network for improved image quality
    Agrawal, D.
    Singhai, J.
    [J]. IET IMAGE PROCESSING, 2010, 4 (06) : 443 - 451
  • [2] Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    [J]. IEEE SENSORS JOURNAL, 2016, 16 (01) : 203 - 209
  • [3] THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE
    BURT, PJ
    ADELSON, EH
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) : 532 - 540
  • [4] Cao Z.G., 2005, Opto-Electronic Eng., V32, P72, DOI [10.1007/978-3-319-14992-9, DOI 10.1007/978-3-319-14992-9]
  • [5] Mean shift: A robust approach toward feature space analysis
    Comaniciu, D
    Meer, P
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (05) : 603 - 619
  • [6] Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition
    Cui, Guangmang
    Feng, Huajun
    Xu, Zhihai
    Li, Qi
    Chen, Yueting
    [J]. OPTICS COMMUNICATIONS, 2015, 341 : 199 - 209
  • [7] Ding Wb., 2017, Acta Opt. Sin., V37, DOI [10.3788/AOS201737.1010002, DOI 10.3788/AOS201737.1010002]
  • [8] Feature and Model Level Fusion of Pretrained CNN for Remote Sensing Scene Classification
    Du, Peijun
    Li, Erzhu
    Xia, Junshi
    Samat, Alim
    Bai, Xuyu
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (08) : 2600 - 2611
  • [9] Image quality measures and their performance
    Eskicioglu, AM
    Fisher, PS
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) : 2959 - 2965
  • [10] FAST 2-DIMENSIONAL MEDIAN FILTERING ALGORITHM
    HUANG, TS
    YANG, GJ
    TANG, GY
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1979, 27 (01): : 13 - 18