Multiscale infrared and visible image fusion using gradient domain guided image filtering

被引:42
作者
Zhu, Jin [1 ]
Jin, Weiqi [1 ]
Li, Li [1 ]
Han, Zhenghao [1 ]
Wang, Xia [1 ]
机构
[1] Beijing Inst Technol, MoE Key Lab Photoelect Imaging Technol & Syst, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Gradient domain guided image filtering; Multiscale decomposition; Infrared and visible imaging; Visual saliency; SALIENCY DETECTION; DECOMPOSITION; QUALITY; INFORMATION;
D O I
10.1016/j.infrared.2017.12.003
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
For better surveillance with infrared and visible imaging, a novel hybrid multiscale decomposition fusion method using gradient domain guided image filtering (HMSD-GDGF) is proposed in this study. In this method, hybrid multiscale decomposition with guided image filtering and gradient domain guided image filtering of source images are first applied before the weight maps of each scale are obtained using a saliency detection technology and filtering means with three different fusion rules at different scales. The three types of fusion rules are for small-scale detail level, large-scale detail level, and base level. Finally, the target becomes more salient and can be more easily detected in the fusion result, with the detail information of the scene being fully displayed. After analyzing the experimental comparisons with state-of-the-art fusion methods, the HMSD-GDGF method has obvious advantages in fidelity of salient information (including structural similarity, brightness, and contrast), preservation of edge features, and human visual perception. Therefore, visual effects can be improved by using the proposed HMSD-GDGF method. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:8 / 19
页数:12
相关论文
共 41 条
[11]   The multiscale directional bilateral filter and its application to multisensor image fusion [J].
Hu, Jianwen ;
Li, Shutao .
INFORMATION FUSION, 2012, 13 (03) :196-206
[12]   Gradient Domain Guided Image Filtering [J].
Kou, Fei ;
Chen, Weihai ;
Wen, Changyun ;
Li, Zhengguo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :4528-4539
[13]   An improved fusion algorithm for infrared and visible images based on multi-scale transform [J].
Li, He ;
Liu, Lei ;
Huang, Wei ;
Yue, Chao .
INFRARED PHYSICS & TECHNOLOGY, 2016, 74 :28-37
[14]   Infrared and visible image fusion scheme based on NSCT and low-level visual features [J].
Li, Huafeng ;
Qiu, Hongmei ;
Yu, Zhengtao ;
Zhang, Yafei .
INFRARED PHYSICS & TECHNOLOGY, 2016, 76 :174-184
[15]   Pixel-level image fusion: A survey of the state of the art [J].
Li, Shutao ;
Kang, Xudong ;
Fang, Leyuan ;
Hu, Jianwen ;
Yin, Haitao .
INFORMATION FUSION, 2017, 33 :100-112
[16]   Image Fusion with Guided Filtering [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) :2864-2875
[17]   Performance comparison of different multi-resolution transforms for image fusion [J].
Li, Shutao ;
Yang, Bin ;
Hu, Jianwen .
INFORMATION FUSION, 2011, 12 (02) :74-84
[18]   Image fusion via nonlocal sparse K-SVD dictionary learning [J].
Li, Ying ;
Li, Fangyi ;
Bai, Bendu ;
Shen, Qiang .
APPLIED OPTICS, 2016, 55 (07) :1814-1823
[19]   Infrared and visible image fusion method based on saliency detection in sparse domain [J].
Liu, C. H. ;
Qi, Y. ;
Ding, W. R. .
INFRARED PHYSICS & TECHNOLOGY, 2017, 83 :94-102
[20]   Image Fusion With Convolutional Sparse Representation [J].
Liu, Yu ;
Chen, Xun ;
Ward, Rabab K. ;
Wang, Z. Jane .
IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (12) :1882-1886