Two-scale image fusion of visible and infrared images using saliency detection

被引:335
作者
Bavirisetti, Durga Prasad [1 ]
Dhuli, Ravindra [1 ]
机构
[1] VIT Univ, Sch Elect Engn, Vellore 632014, Tamil Nadu, India
关键词
Multi-scale image decomposition; Image fusion; Visual saliency; Weight map; PERFORMANCE; DECOMPOSITION; EXTRACTION;
D O I
10.1016/j.infrared.2016.01.009
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Military, navigation and concealed weapon detection need different imaging modalities such as visible and infrared to monitor a targeted scene. These modalities provide complementary information. For better situation awareness, complementary information of these images has to be integrated into a single image. Image fusion is the process of integrating complementary source information into a composite image. In this paper, we propose a new image fusion method based on saliency detection and two scale image decomposition. This method is beneficial because the visual saliency extraction process introduced in this paper can highlight the saliency information of source images very well. A-new weight map construction process based on visual saliency is proposed. This process is able to integrate the visually significant information of source images into the fused image. In contrast to most of the multi-scale image fusion techniques, proposed technique uses only two-scale image decomposition. So it is fast and efficient. Our method is tested on several image pairs and is evaluated qualitatively by visual inspection and quantitatively using objective fusion metrics. Outcomes of the proposed method are compared with the state-of-art multi-scale fusion techniques. Results reveal that the proposed method performance is comparable or superior to the existing methods. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:52 / 64
页数:13
相关论文
共 32 条
[1]  
Achanta R, 2008, LECT NOTES COMPUT SC, V5008, P66
[2]  
Aggarwal J., 2013, Multisensor Fusion for Computer Vision, V99
[3]  
Akerman III Alexander, 1992, APPL OPTICAL SCI ENG
[4]  
Anderson Charles H., 1988, U.S. Patent, Patent No. [4,718,104, 4718104]
[5]  
Bavirisetti D.P., 2015, INT REV COMPUT SOFTW, V10, P757, DOI 10.15866/irecos.v10i7.6793
[6]  
BAVIRISETTI DP, 2016, ELECT LETT COMPUT VI, V14, P58, DOI DOI 10.5565/REV/ELCVIA.793
[7]   Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
IEEE SENSORS JOURNAL, 2016, 16 (01) :203-209
[8]  
Burt P.J., 1992, PROC SOC INFORM DISP, P467
[9]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[10]   Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition [J].
Cui, Guangmang ;
Feng, Huajun ;
Xu, Zhihai ;
Li, Qi ;
Chen, Yueting .
OPTICS COMMUNICATIONS, 2015, 341 :199-209