A novel multiscale transform decomposition based multi-focus image fusion framework

被引:22
作者
Li, Liangliang [1 ]
Ma, Hongbing [1 ]
Jia, Zhenhong [2 ]
Si, Yujuan [3 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
[3] Jilin Univ, Coll Commun Engn, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiscale transform; Multi-focus image fusion; NSCT; Difference image; Energy of the gradient; ENHANCEMENT; ROBUST; FILTER; MODEL;
D O I
10.1007/s11042-020-10462-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, we propose a novel multiscale transform decomposition model for multi-focus image fusion to get a better fused performance. The motivation of the proposed fusion framework is to make full use of the decomposition characteristics of multiscale transform. The nonsubsampled contourlet transform (NSCT) is firstly used to decompose the source multi-focus images into low-frequency (LF) and several high-frequency (HF) bands to separate out the two basic characteristics of source images, i.e., principal information and edge details. The common "average" and "max-absolute" fusion rules are performed on low- and high-frequency components, respectively, and a basic fusion image is generated. Then the difference images between the basic fused image and the source images are calculated, and the energy of the gradient (EOG) of difference images are utilized to refine the basic fused image by integrating average filter and median filter. Visual and quantitative using fusion metrics like VIFF, Q(S), MI, Q(AB/F), SD, Q(PC) and running time comparisons to state-of-the-art algorithms demonstrate the out-performance of the proposed fusion technique.
引用
收藏
页码:12389 / 12409
页数:21
相关论文
共 64 条
[1]   Fast curvelet transform through genetic algorithm for multimodal medical image fusion [J].
Arif, Muhammad ;
Wang, Guojun .
SOFT COMPUTING, 2020, 24 (03) :1815-1836
[2]   Diabetic plantar pressure analysis using image fusion [J].
Cao, Luying ;
Dey, Nilanjan ;
Ashour, Amira S. ;
Fong, Simon ;
Sherratt, R. Simon ;
Wu, Lijun ;
Shi, Fuqian .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (15-16) :11213-11236
[3]   Weighted image fusion using cross bilateral filter and non-subsampled contourlet transform [J].
Ch, M. Munawwar Iqbal ;
Riaz, M. Mohsin ;
Iltaf, Naima ;
Ghafoor, Abdul ;
Ahmad, Attiq .
MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2019, 30 (04) :2199-2210
[4]   Infrared and visible image fusion based on target-enhanced multiscale transform decomposition [J].
Chen, Jun ;
Li, Xuejiao ;
Luo, Linbo ;
Mei, Xiaoguang ;
Ma, Jiayi .
INFORMATION SCIENCES, 2020, 508 :64-78
[5]   A Novel Rolling Bearing Fault Diagnosis and Severity Analysis Method [J].
Chen, Yinsheng ;
Zhang, Tinghao ;
Luo, Zhongming ;
Sun, Kun .
APPLIED SCIENCES-BASEL, 2019, 9 (11)
[6]   Effect of groove shape on the hydrodynamic lubrication of journal bearing considering cavitation [J].
Chen, Yu ;
Feng, Jun ;
Sun, Y. ;
Peng, Xu ;
Dai, Qiao ;
Yu, Chengtao .
ENGINEERING COMPUTATIONS, 2020, 37 (05) :1557-1576
[7]   The improved image inpainting algorithm via encoder and similarity constraint [J].
Chen, Yuantao ;
Liu, Linwu ;
Tao, Jiajun ;
Xia, Runlong ;
Zhang, Qian ;
Yang, Kai ;
Xiong, Jie ;
Chen, Xi .
VISUAL COMPUTER, 2021, 37 (07) :1691-1705
[8]   Saliency Detection via the Improved Hierarchical Principal Component Analysis Method [J].
Chen, Yuantao ;
Tao, Jiajun ;
Zhang, Qian ;
Yang, Kai ;
Chen, Xi ;
Xiong, Jie ;
Xia, Runlong ;
Xie, Jingbo .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020
[9]   Research of improving semantic image segmentation based on a feature fusion model [J].
Chen, Yuantao ;
Tao, Jiajun ;
Liu, Linwu ;
Xiong, Jie ;
Xia, Runlong ;
Xie, Jingbo ;
Zhang, Qian ;
Yang, Kai .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 13 (11) :5033-5045
[10]   A novel online incremental and decremental learning algorithm based on variable support vector machine [J].
Chen, Yuantao ;
Xiong, Jie ;
Xu, Weihong ;
Zuo, Jingwen .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 3) :S7435-S7445