Injected Infrared and Visible Image Fusion via L1 Decomposition Model and Guided Filtering

被引:56
作者
Yan, Hui [1 ]
Zhang, Jin-Xi [1 ]
Zhang, Xuefeng [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Coll Sci, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Guided filter; IR and VIS image fusion; injected fusion; L-1; norm; NETWORK;
D O I
10.1109/TCI.2022.3151472
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, an infrared (IR) and visible (VIS) image fusion algorithm is designed for the injection of the IR objects into the VIS background in a perceptual manner. It consists of four parts: image decomposition, layer fusion, image reconstruction, and image refinement. An edge-preserving filter is constructed for image decomposition, in which an L-1 regularization term and a fractional gradient are newly introduced. The resulting filter is capable of not only preserving edges, but also attenuating the influence of the IR background. A two-layer fusion rule is adopted, which consists of a routine weighted-average fusion rule and an injected fusion rule. It ensures that the fused image is with both rich background information of the VIS image and the salient features of the IR image. After image reconstruction, the guided filter is applied again to the IR image to refine the fused image, such that the final version of the fused image is with satisfactory human visual perception under even dim lights. The effectiveness and superiority of our fusion algorithm are illustrated by the results of ablation studies and comparative experiments.
引用
收藏
页码:162 / 173
页数:12
相关论文
共 49 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]   Adaptive Near-Infrared and Visible Fusion for Fast Image Enhancement [J].
Awad, Mohamed ;
Elliethy, Ahmed ;
Aly, Hussein A. .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 :408-418
[3]   Fractional-order anisotropic diffusion for image denoising [J].
Bai, Jian ;
Feng, Xiang-Chu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (10) :2492-2502
[4]   Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
IEEE SENSORS JOURNAL, 2016, 16 (01) :203-209
[5]   A novel image fusion framework for night-vision navigation and surveillance [J].
Bhatnagar, Gaurav ;
Liu, Zheng .
SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 :165-175
[6]   Human visual system inspired multi-modal medical image fusion framework [J].
Bhatnagar, Gaurav ;
Wu, Q. M. Jonathan ;
Liu, Zheng .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (05) :1708-1720
[7]   An L1 Image Transform for Edge-Preserving Smoothing and Scene-Level Intrinsic Decomposition [J].
Bi, Sai ;
Han, Xiaoguang ;
Yu, Yizhou .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (04)
[8]   Geometry-Aware Learning of Maps for Camera Localization [J].
Brahmbhatt, Samarth ;
Gu, Jinwei ;
Kim, Kihwan ;
Hays, James ;
Kautz, Jan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2616-2625
[9]   Infrared and visible image fusion based on target-enhanced multiscale transform decomposition [J].
Chen, Jun ;
Li, Xuejiao ;
Luo, Linbo ;
Mei, Xiaoguang ;
Ma, Jiayi .
INFORMATION SCIENCES, 2020, 508 :64-78
[10]   Towards perceptual image fusion: A novel two-layer framework [J].
Deng, Chenwei ;
Liu, Xun ;
Chanussot, Jocelyn ;
Xu, Yang ;
Zhao, Baojun .
INFORMATION FUSION, 2020, 57 :102-114