An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information

被引:7
|
作者
Li, Qingqing [1 ,2 ]
Han, Guangliang [1 ]
Liu, Peixun [1 ]
Yang, Hang [1 ]
Wu, Jiajia [1 ,2 ]
Liu, Dongxu [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; base layer; detail layer; saliency map; gradient information; CONTOURLET TRANSFORM; ENHANCEMENT; EXTRACTION;
D O I
10.1109/ACCESS.2021.3101639
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion is a hot topic due to the perfect complementarity of their information. There are two key problems in infrared and visible image fusion. One is how to extract significant target areas and rich texture details from the source images, and the other is how to integrate them to produce satisfactory fused images. To tackle these problems, we propose a novel fusion framework in this paper. A multi-level image decomposition method is used to obtain the base layer and detail layer of the source image. For the fusion of base layer, an ingenious fusion strategy guided by the saliency map of source image is designed to improve the intensity of salient targets and the visual quality of the fused image. For the fusion of detail layer, an efficient approach by introducing the enhanced gradient information is presented to boost the detail features and sharpen the edges of the fused image. Experimental results demonstrate that, compared with fifteen classical and advanced fusion methods, the proposed image fusion framework has better performance in both subjective and objective evaluation.
引用
收藏
页码:108942 / 108958
页数:17
相关论文
共 50 条
  • [31] A Real-Time FPGA Implementation of Infrared and Visible Image Fusion Using Guided Filter and Saliency Detection
    Zhang, Ling
    Yang, Xuefei
    Wan, Zhenlong
    Cao, Dingxin
    Lin, Yingcheng
    SENSORS, 2022, 22 (21)
  • [32] Infrared and Visible Image Fusion Based on Visual Saliency Map and Image Contrast Enhancement
    Liu, Yuanyuan
    Wu, Zhiyong
    Han, Xizhen
    Sun, Qiang
    Zhao, Jian
    Liu, Jianzhuo
    SENSORS, 2022, 22 (17)
  • [33] DSFusion: Infrared and visible image fusion method combining detail and scene information
    Liu, Kuizhuang
    Li, Min
    Chen, Cheng
    Rao, Chengwei
    Zuo, Enguang
    Wang, Yunling
    Yan, Ziwei
    Wang, Bo
    Chen, Chen
    Lv, Xiaoyi
    PATTERN RECOGNITION, 2024, 154
  • [34] Infrared and Visible Image Fusion Method Based on Information Enhancement and Mask Loss
    Zhang, Xiaodong
    Wang, Shuo
    Gao, Shaoshu
    Wang, Xinrui
    Zhang, Long
    ACTA PHOTONICA SINICA, 2024, 53 (09)
  • [35] Image Fusion Method for Infrared and Visible Light Images based on SWT and Regional Gradient
    Deng, Yi
    Li, Chanfei
    Zhang, Zili
    Wang, Dan
    2017 IEEE 3RD INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC), 2017, : 976 - 979
  • [36] CsdlFusion: An Infrared and Visible Image Fusion Method Based on LatLRR-NSST and Compensated Saliency Detection
    Chen, Hui
    Wu, Ziming
    Sun, Zihui
    Yang, Ning
    Menhas, Muhammad llyas
    Ahmad, Bilal
    JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2025, 53 (01) : 117 - 134
  • [37] Multisensor Infrared and Visible Image Fusion via Double Joint Edge Preservation Filter and Nonglobally Saliency Gradient Operator
    Zhang, Yingmei
    Lee, Hyo Jong
    IEEE SENSORS JOURNAL, 2023, 23 (09) : 10252 - 10267
  • [38] INFRARED AND VISIBLE IMAGE FUSION USING SALIENCY DETECTION BASED ON SHEARLET TRANSFORM
    Fei, Chun
    Zhang, Ping
    Tian, Ming
    Wang, Xiaowei
    Wu, Jiang
    2016 13TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2016, : 273 - 276
  • [39] A Novel Infrared and Visible Image Information Fusion Method Based on Phase Congruency and Image Entropy
    Huang, Xinghua
    Qi, Guanqiu
    Wei, Hongyan
    Chai, Yi
    Sim, Jaesung
    ENTROPY, 2019, 21 (12)
  • [40] Adaptive Infrared and Visible Image Fusion Based on Visual Saliency and Hierarchical Bayesian
    Fu, Sunsi
    Zheng, Rushan
    Chen, Xiong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71