Multifocus image fusion by combining with mixed-order structure tensors and multiscale neighborhood

被引:64
作者
Li, Huafeng [1 ]
Li, Xiaosong [1 ]
Yu, Zhengtao [1 ]
Mao, Cunli [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Yunnan, Peoples R China
基金
中国国家自然科学基金;
关键词
Fractional differential; Multifocus image fusion; Multiscale focus measure; Multiscale neighborhood; Structure tensor; DUAL-TREE COMPLEX; CONTOURLET TRANSFORM; PERFORMANCE; WAVELET; INFORMATION; SCHEME; SEGMENTATION; SIMILARITY; PROJECTION; ALGORITHM;
D O I
10.1016/j.ins.2016.02.030
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we propose a new method for multifocus image fusion by combining with the structure tensors of mixed order differentials and the multiscale neighborhood. In this method, the structure tensor of an integral differential is utilized to detect the high frequency regions and the structure tensor of the fractional differential is used to detect the low frequency regions. To improve the performance of the fusion method, we propose a new focus measure based on the multiscale neighborhood technique to generate the initial fusion decision maps by exploiting the advantages of different scales. Next, based on the multiscale neighborhood technique, a post-processing method is used to update the initial fusion decision maps. During the fusion process, the pixels located in the focused inner regions are selected to produce the fused image. In order to avoid discontinuities in the transition zone between the focused and defocused regions, we propose a new "averaging" scheme based on the fusion decision maps at different scales. Our experimental results demonstrate that the proposed method outperformed the conventional multifocus image fusion methods in terms of both their subjective and objective quality. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:25 / 49
页数:25
相关论文
共 73 条
[21]   Pixel- and region-based image fusion with complex wavelets [J].
Lewis, John J. ;
O'Callaghan, Robert J. ;
Nikolov, Stavri G. ;
Bull, David R. ;
Canagarajah, Nishan .
INFORMATION FUSION, 2007, 8 (02) :119-130
[22]   MULTISENSOR IMAGE FUSION USING THE WAVELET TRANSFORM [J].
LI, H ;
MANJUNATH, BS ;
MITRA, SK .
GRAPHICAL MODELS AND IMAGE PROCESSING, 1995, 57 (03) :235-245
[23]   Fractional differential and variational method for image fusion and super-resolution [J].
Li, Huafeng ;
Yu, Zhengtao ;
Mao, Cunli .
NEUROCOMPUTING, 2016, 171 :138-148
[24]   A new fusion scheme for multifocus images based on focused pixels detection [J].
Li, Huafeng ;
Chai, Yi ;
Li, Zhaofei .
MACHINE VISION AND APPLICATIONS, 2013, 24 (06) :1167-1181
[25]   Multifocus image fusion by combining curvelet and wavelet transform [J].
Li, Shutao ;
Yang, Bin .
PATTERN RECOGNITION LETTERS, 2008, 29 (09) :1295-1301
[26]   Multifocus image fusion using region segmentation and spatial frequency [J].
Li, Shutao ;
Yang, Bin .
IMAGE AND VISION COMPUTING, 2008, 26 (07) :971-979
[27]   Image Fusion with Guided Filtering [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) :2864-2875
[28]   Image matting for fusion of multi-focus images in dynamic scenes [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen ;
Yang, Bin .
INFORMATION FUSION, 2013, 14 (02) :147-162
[29]   Fusion methods based on dynamic-segmented morphological wavelet or cut and paste for multifocus images [J].
Lin, Phen-Lan ;
Huang, Po-Ying .
SIGNAL PROCESSING, 2008, 88 (06) :1511-1527
[30]   Multiview Alignment Hashing for Efficient Image Search [J].
Liu, Li ;
Yu, Mengyang ;
Shao, Ling .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (03) :956-966