An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information

被引:7
|
作者
Li, Qingqing [1 ,2 ]
Han, Guangliang [1 ]
Liu, Peixun [1 ]
Yang, Hang [1 ]
Wu, Jiajia [1 ,2 ]
Liu, Dongxu [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; base layer; detail layer; saliency map; gradient information; CONTOURLET TRANSFORM; ENHANCEMENT; EXTRACTION;
D O I
10.1109/ACCESS.2021.3101639
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion is a hot topic due to the perfect complementarity of their information. There are two key problems in infrared and visible image fusion. One is how to extract significant target areas and rich texture details from the source images, and the other is how to integrate them to produce satisfactory fused images. To tackle these problems, we propose a novel fusion framework in this paper. A multi-level image decomposition method is used to obtain the base layer and detail layer of the source image. For the fusion of base layer, an ingenious fusion strategy guided by the saliency map of source image is designed to improve the intensity of salient targets and the visual quality of the fused image. For the fusion of detail layer, an efficient approach by introducing the enhanced gradient information is presented to boost the detail features and sharpen the edges of the fused image. Experimental results demonstrate that, compared with fifteen classical and advanced fusion methods, the proposed image fusion framework has better performance in both subjective and objective evaluation.
引用
收藏
页码:108942 / 108958
页数:17
相关论文
共 50 条
  • [41] Infrared and Visible Image Fusion Using Modified PCNN and Visual Saliency Detection
    Ding, Zhaisheng
    Zhou, Dongming
    Nie, Rencan
    Hou, Ruichao
    Liu, Yanyu
    2018 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2018, 10836
  • [42] A Novel Saliency-Based Decomposition Strategy for Infrared and Visible Image Fusion
    Qi, Biao
    Bai, Xiaotian
    Wu, Wei
    Zhang, Yu
    Lv, Hengyi
    Li, Guoning
    REMOTE SENSING, 2023, 15 (10)
  • [43] Infrared and Visible Image Fusion Based on Deep Decomposition Network and Saliency Analysis
    Jian, Lihua
    Rayhana, Rakiba
    Ma, Ling
    Wu, Shaowu
    Liu, Zheng
    Jiang, Huiqin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3314 - 3326
  • [44] Infrared and visible image fusion based on QNSCT and Guided Filter
    Yang, Chenxuan
    He, Yunan
    Sun, Ce
    Jiang, Sheng
    Li, Ye
    Zhao, Peng
    OPTIK, 2022, 253
  • [45] Infrared and Visible Image Fusion Using Anisotropic Guided Filtering
    Tong, Zhaoyang
    Yang, Shen
    Du, Shibin
    Huang, Zefeng
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (24)
  • [46] Infrared and Visible Image Fusion Objective Evaluation Method
    Ledwon, Daniel
    Juszczyk, Jan
    Pietka, Ewa
    INFORMATION TECHNOLOGY IN BIOMEDICINE, 2019, 1011 : 268 - 279
  • [47] Infrared and Visible Image Fusion Based on Iterative Guided Filtering and Multi-visual Weight Information
    Zhu Hao-ran
    Liu Yun-qing
    Zhang Wen-ying
    ACTA PHOTONICA SINICA, 2019, 48 (03)
  • [48] MGFusion: a multimodal large language model-guided information perception for infrared and visible image fusion
    Yang, Zengyi
    Li, Yunping
    Tang, Xin
    Xie, Minghong
    FRONTIERS IN NEUROROBOTICS, 2024, 18
  • [49] Infrared and visible images fusion method based on gradient weighted
    Yang, Guang
    Tong, Tao
    Meng, Qiangqiang
    Sun, Jiacheng
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2014, 43 (08): : 2772 - 2779
  • [50] GANSD: A generative adversarial network based on saliency detection for infrared and visible image fusion
    Fu, Yinghua
    Liu, Zhaofeng
    Peng, Jiansheng
    Gupta, Rohit
    Zhang, Dawei
    IMAGE AND VISION COMPUTING, 2025, 154