A novel multiscale transform decomposition based multi-focus image fusion framework

被引:22
作者
Li, Liangliang [1 ]
Ma, Hongbing [1 ]
Jia, Zhenhong [2 ]
Si, Yujuan [3 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
[3] Jilin Univ, Coll Commun Engn, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiscale transform; Multi-focus image fusion; NSCT; Difference image; Energy of the gradient; ENHANCEMENT; ROBUST; FILTER; MODEL;
D O I
10.1007/s11042-020-10462-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, we propose a novel multiscale transform decomposition model for multi-focus image fusion to get a better fused performance. The motivation of the proposed fusion framework is to make full use of the decomposition characteristics of multiscale transform. The nonsubsampled contourlet transform (NSCT) is firstly used to decompose the source multi-focus images into low-frequency (LF) and several high-frequency (HF) bands to separate out the two basic characteristics of source images, i.e., principal information and edge details. The common "average" and "max-absolute" fusion rules are performed on low- and high-frequency components, respectively, and a basic fusion image is generated. Then the difference images between the basic fused image and the source images are calculated, and the energy of the gradient (EOG) of difference images are utilized to refine the basic fused image by integrating average filter and median filter. Visual and quantitative using fusion metrics like VIFF, Q(S), MI, Q(AB/F), SD, Q(PC) and running time comparisons to state-of-the-art algorithms demonstrate the out-performance of the proposed fusion technique.
引用
收藏
页码:12389 / 12409
页数:21
相关论文
共 64 条
[21]   A Novel Infrared and Visible Image Information Fusion Method Based on Phase Congruency and Image Entropy [J].
Huang, Xinghua ;
Qi, Guanqiu ;
Wei, Hongyan ;
Chai, Yi ;
Sim, Jaesung .
ENTROPY, 2019, 21 (12)
[22]   Multi-modality medical image fusion technique using multi-objective differential evolution based deep neural networks [J].
Kaur, Manjit ;
Singh, Dilbag .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (02) :2483-2493
[23]   Multi-focus image fusion based on dynamic threshold neural P systems and surfacelet transform [J].
Li, Bo ;
Peng, Hong ;
Wang, Jun ;
Huang, Xiangnian .
KNOWLEDGE-BASED SYSTEMS, 2020, 196
[24]   A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain [J].
Li, Liangliang ;
Si, Yujuan ;
Wang, Linli ;
Jia, Zhenhong ;
Ma, Hongbing .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (33-34) :24303-24328
[25]   Brain Image Enhancement Approach Based on Singular Value Decomposition in Nonsubsampled Shearlet Transform Domain [J].
Li, Liangliang ;
Si, Yujuan ;
Wang, Linli ;
Jia, Zhenhong ;
Ma, Hongbing .
JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2020, 10 (08) :1785-1794
[26]   A Novel Medical Image Fusion Approach Based on Nonsubsampled Shearlet Transform [J].
Li, Liangliang ;
Wang, Linli ;
Wang, Zuoxu ;
Jia, Zhenhong ;
Si, Yujuan ;
Yang, Jie ;
Kasabov, Nikola .
JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2019, 9 (09) :1815-1826
[27]   Enhancement of hyperspectral remote sensing images based on improved fuzzy contrast in nonsubsampled shearlet transform domain [J].
Li, Liangliang ;
Si, Yujuan .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (13) :18077-18094
[28]   A novel brain image enhancement method based on nonsubsampled contourlet transform [J].
Li, Liangliang ;
Si, Yujuan ;
Jia, Zhenhong .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2018, 28 (02) :124-131
[29]   Human β-defensin 3 gene modification promotes the osteogenic differentiation of human periodontal ligament cells and bone repair in periodontitis [J].
Li, Lingjun ;
Jiang, Han ;
Chen, Rixin ;
Zhou, Jing ;
Xiao, Yin ;
Zhang, Yangheng ;
Yan, Fuhua .
INTERNATIONAL JOURNAL OF ORAL SCIENCE, 2020, 12 (01)
[30]   Image Fusion with Guided Filtering [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) :2864-2875