Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

被引:73
作者
Chen, Jun [1 ]
Li, Xuejiao [1 ]
Luo, Linbo [2 ]
Ma, Jiayi [3 ]
机构
[1] China Univ Geosci, Sch Automat, Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Peoples R China
[2] China Univ Geosci, Sch Mech Engn & Elect Informat, Wuhan 430074, Peoples R China
[3] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Transforms; Image segmentation; Image edge detection; Correlation; Data mining; Training; Decision map; focus measurement; image matting; multi-focus image fusion; GENERATIVE ADVERSARIAL NETWORK; QUALITY ASSESSMENT; ALGORITHM; PERFORMANCE;
D O I
10.1109/TMM.2021.3057493
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion technology is to extract different focused regions of the same scene among partially focused images and merge them together to generate a composite image where all objects are clear. Two crucial points to multi-focus image fusion are the effective focus measurement method to evaluate the sharpness of the source images and the accurate segmentation method to extract the focused regions. In conventional multi-focus image fusion methods, the decision map obtained according to the focus measurement is sensitive to mis-registration, or produces an uneven boundary lines. In this paper, the maximum value in the top-hat transform and the bottom-hat transform is used as the gradient measurement value, and the complementary features between multiple scales are used to achieve accurate focus measurement for initial segmentation. In order to obtain a better fusion decision map, a robust image matting algorithm is used to refine the trimap generated by the initial segmentation. Then, make full use of the strong correlation between the source images to optimize the edge regions of the decision map to improve the image fusion quality. Finally, a fusion image is constructed based on the fusion decision map and the source images. We perform qualitative and quantitative experiments on publicly available databases to verify the effectiveness of the method. The results show that compared with several state-of-the-art algorithms, the proposed fusion method can obtain accurate decision maps and achieve better performance in visual perception and quantitative analysis.
引用
收藏
页码:655 / 667
页数:13
相关论文
共 58 条
[1]   Fusion of multi-focus images using differential evolution algorithm [J].
Aslantas, V. ;
Kurban, R. .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (12) :8861-8870
[2]   Quadtree-based multi-focus image fusion using a weighted focus-measure [J].
Bai, Xiangzhi ;
Zhang, Yu ;
Zhou, Fugen ;
Xue, Bindang .
INFORMATION FUSION, 2015, 22 :105-118
[3]   Fusion of infrared and visual images through region extraction by using multi scale center-surround top-hat transform [J].
Bai, Xiangzhi ;
Zhou, Fugen ;
Xue, Bindang .
OPTICS EXPRESS, 2011, 19 (09) :8444-8457
[4]   Spatiotemporal Image Fusion in Remote Sensing [J].
Belgiu, Mariana ;
Stein, Alfred .
REMOTE SENSING, 2019, 11 (07)
[5]   Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain [J].
Bhatnagar, Gaurav ;
Wu, Q. M. Jonathan ;
Liu, Zheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (05) :1014-1024
[6]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[7]   A new automated quality assessment algorithm for image fusion [J].
Chen, Yin ;
Blum, Rick S. .
IMAGE AND VISION COMPUTING, 2009, 27 (10) :1421-1432
[8]   Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure [J].
De, Ishita ;
Chanda, Bhabatosh .
INFORMATION FUSION, 2013, 14 (02) :136-146
[9]   Multi-focus image fusion based on non-subsampled shearlet transform [J].
Gao Guorong ;
Xu Luping ;
Feng Dongzhu .
IET IMAGE PROCESSING, 2013, 7 (06) :633-639
[10]   Image fusion: Advances in the state of the art [J].
Goshtasby, A. Ardeshir ;
Nikolov, Stavri .
INFORMATION FUSION, 2007, 8 (02) :114-118