Image fusion based on object region detection and Non-Subsampled Contourlet Transform

被引:66
作者
Meng, Fanjie [1 ]
Song, Miao [2 ]
Guo, Baolong [1 ]
Shi, Ruixia [1 ]
Shan, Dalong [1 ]
机构
[1] Xidian Univ, Inst Intelligent Control & Image Engn, Xian, Shaanxi, Peoples R China
[2] Neusoft Med Syst Co Ltd, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Object region detection; The Non-Subsampled Contourlet Transform; Fusion rule; DOMAIN;
D O I
10.1016/j.compeleceng.2016.09.019
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a new fusion algorithm for infrared (IR) and visible light (ViS) images by combining object region detection with the Non-Subsampled Contourlet Transform (NSCT). First, the saliency map for the IR image is acquired with saliency detection. Second, the object region in the IR image is extracted by introducing a free regions removal method. Third, source images are decomposed via NSCT and different fusion rules for low frequency sub-bands and high frequency sub-bands are employed. Then, the primary fused image is generated by the inverse NSCT. Finally, integrating the primary fused image with the object region, the final fused image is obtained. By conducting experiments, we compare our method to others using several metrics and results show that the proposed method can improve the quality of the fused image. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:375 / 383
页数:9
相关论文
共 17 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]   Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain [J].
Bhatnagar, Gaurav ;
Wu, Q. M. Jonathan ;
Liu, Zheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (05) :1014-1024
[3]   Multi-Focus Image Fusion Based on Spatial Frequency in Discrete Cosine Transform Domain [J].
Cao, Liu ;
Jin, Longxu ;
Tao, Hongjiang ;
Li, Guoning ;
Zhuang, Zhuang ;
Zhang, Yanfu .
IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (02) :220-224
[4]  
[陈天华 Chen Tianhua], 2013, [北京交通大学学报. 自然科学版, Journal of Beijing Jiaotong University], V37, P18
[5]   The nonsubsampled contourlet transform: Theory, design, and applications [J].
da Cunha, Arthur L. ;
Zhou, Jianping ;
Do, Minh N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (10) :3089-3101
[6]  
Desale RP, 2013, INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, IMAGE PROCESSING AND PATTERN RECOGNITION (ICSIPR 2013), P66, DOI 10.1109/ICSIPR.2013.6497960
[7]   High quality multi-spectral and panchromatic image fusion technologies based on Curvelet transform [J].
Dong, Limin ;
Yang, Qingxiang ;
Wu, Haiyong ;
Xiao, Huachao ;
Xu, Mingliang .
NEUROCOMPUTING, 2015, 159 :268-274
[8]   Multiscale Image Fusion Using the Undecimated Wavelet Transform With Spectral Factorization and Nonorthogonal Filter Banks [J].
Ellmauthaler, Andreas ;
Pagliari, Carla L. ;
da Silva, Eduardo A. B. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (03) :1005-1017
[9]   Fast saliency-aware multi-modality image fusion [J].
Han, Jungong ;
Pauwels, Eric J. ;
de Zeeuw, Paul .
NEUROCOMPUTING, 2013, 111 :70-80
[10]   Fusion technique for grey-scale visible light and infrared images based on non-subsampled contourlet transform and intensity-hue-saturation transform [J].
Kong, W. ;
Lei, Y. ;
Lei, Y. ;
Ni, X. .
IET SIGNAL PROCESSING, 2011, 5 (01) :75-80