An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information

被引:7
|
作者
Li, Qingqing [1 ,2 ]
Han, Guangliang [1 ]
Liu, Peixun [1 ]
Yang, Hang [1 ]
Wu, Jiajia [1 ,2 ]
Liu, Dongxu [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; base layer; detail layer; saliency map; gradient information; CONTOURLET TRANSFORM; ENHANCEMENT; EXTRACTION;
D O I
10.1109/ACCESS.2021.3101639
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion is a hot topic due to the perfect complementarity of their information. There are two key problems in infrared and visible image fusion. One is how to extract significant target areas and rich texture details from the source images, and the other is how to integrate them to produce satisfactory fused images. To tackle these problems, we propose a novel fusion framework in this paper. A multi-level image decomposition method is used to obtain the base layer and detail layer of the source image. For the fusion of base layer, an ingenious fusion strategy guided by the saliency map of source image is designed to improve the intensity of salient targets and the visual quality of the fused image. For the fusion of detail layer, an efficient approach by introducing the enhanced gradient information is presented to boost the detail features and sharpen the edges of the fused image. Experimental results demonstrate that, compared with fifteen classical and advanced fusion methods, the proposed image fusion framework has better performance in both subjective and objective evaluation.
引用
收藏
页码:108942 / 108958
页数:17
相关论文
共 50 条
  • [1] Contrast Saliency Information Guided Infrared and Visible Image Fusion
    Wang, Xue
    Guan, Zheng
    Qian, Wenhua
    Cao, Jinde
    Wang, Chengchao
    Yang, Chao
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 769 - 780
  • [2] SeGFusion: A semantic saliency guided infrared and visible image fusion method
    Xiong, Jinxin
    Liu, Gang
    Tang, Haojie
    Gu, Xinjie
    Bavirisetti, Durga Prasad
    INFRARED PHYSICS & TECHNOLOGY, 2024, 140
  • [3] Infrared and visible image fusion based on saliency and fast guided filtering
    Guo, Zhaoyang
    Yu, Xiantao
    Du, Qinglei
    INFRARED PHYSICS & TECHNOLOGY, 2022, 123
  • [4] VMDM-fusion: a saliency feature representation method for infrared and visible image fusion
    Yong Yang
    Jia-Xiang Liu
    Shu-Ying Huang
    Hang-Yuan Lu
    Wen-Ying Wen
    Signal, Image and Video Processing, 2021, 15 : 1221 - 1229
  • [5] VMDM-fusion: a saliency feature representation method for infrared and visible image fusion
    Yang, Yong
    Liu, Jia-Xiang
    Huang, Shu-Ying
    Lu, Hang-Yuan
    Wen, Wen-Ying
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (06) : 1221 - 1229
  • [6] Multiscale infrared and visible image fusion using gradient domain guided image filtering
    Zhu, Jin
    Jin, Weiqi
    Li, Li
    Han, Zhenghao
    Wang, Xia
    INFRARED PHYSICS & TECHNOLOGY, 2018, 89 : 8 - 19
  • [7] Infrared and visible image fusion method based on saliency detection in sparse domain
    Liu, C. H.
    Qi, Y.
    Ding, W. R.
    INFRARED PHYSICS & TECHNOLOGY, 2017, 83 : 94 - 102
  • [8] SIGFusion: Semantic Information-Guided Infrared and Visible Image Fusion
    Lv, Guohua
    Sima, Chaoqun
    Gao, Yongbiao
    Dong, Aimei
    Ma, Guangxiao
    Cheng, Jinyong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [9] Lightweight Infrared and Visible Image Fusion Technique: Guided Gradient Optimization Driven
    Song, Yuhang
    Wang, Ruijin
    Li, Zengpeng
    Garg, Sahil
    Kaddoum, Georges
    Alrashoud, Mubarak
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 7233 - 7243
  • [10] Infrared and visible images fusion method based on image information
    Ma, Donghui
    Xue, Qun
    Chai, Qi
    Ren, Biao
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2011, 40 (06): : 1168 - 1171