Depth-Distilled Multi-Focus Image Fusion

被引:26
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ]
Lu, Huimin [3 ]
Liu, Yong [4 ]
Yao, Libo [5 ]
Liu, Yu [5 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Kyushu Inst Technol, Kyushu, Japan
[4] Acad Mil Sci, Natl Innovat Inst Def Technol, Beijing 100052, Peoples R China
[5] Naval Aviat Univ, Res Inst informat Fus, Yantai 264001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Feature extraction; Lenses; Task analysis; Testing; Cameras; Adaptation models; Depth distillation; multi-focus image fusion; multi-level decision map fusion; ENHANCEMENT; TRANSFORM; FRAMEWORK; NETWORK;
D O I
10.1109/TMM.2021.3134565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Homogeneous regions, which are smooth areas that lack blur clues to discriminate if they are focused or non-focused. Therefore, they bring a great challenge to achieve high accurate multi-focus image fusion (MFIF). Fortunately, we observe that depth maps are highly related to focus and defocus, containing a preponderance of discriminative power to locate homogeneous regions. This offers the potential to provide additional depth cues to assist MFIF task. Taking depth cues into consideration, in this paper, we propose a new depth-distilled multi-focus image fusion framework, namely D2MFIF. In D2MFIF, depth-distilled model (DDM) is designed for adaptively transferring the depth knowledge into MFIF task, gradually improving MFIF performance. Moreover, multi-level fusion mechanism is designed to integrate multi-level decision maps from intermediate outputs for improving the final prediction. Visually and quantitatively experimental results demonstrate the superiority of our method over several state-of-the-art methods.
引用
收藏
页码:966 / 978
页数:13
相关论文
共 48 条
  • [1] A novel image decomposition-based hybrid technique with super-resolution method for multi-focus image fusion
    Aymaz, Samet
    Kose, Cemal
    [J]. INFORMATION FUSION, 2019, 45 : 113 - 127
  • [2] Conditional Random Field Model for Robust Multi-Focus Image Fusion
    Bouzos, Odysseas
    Andreadis, Ioannis
    Mitianoudis, Nikolaos
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5636 - 5648
  • [3] Carvalho M., 2018, 2018 IEEE 20th International Conference on e-Health Networking, Applications and Services (Healthcom), P1
  • [4] Three-Stream Attention-Aware Network for RGB-D Salient Object Detection
    Chen, Hao
    Li, Youfu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) : 2825 - 2835
  • [5] Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting
    Chen, Jun
    Li, Xuejiao
    Luo, Linbo
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 655 - 667
  • [6] Robust Multi-Focus Image Fusion Using Edge Model and Multi-Matting
    Chen, Yibo
    Guan, Jingwei
    Cham, Wai-Kuen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) : 1526 - 1541
  • [7] Joint Hand-Object 3D Reconstruction From a Single Image With Cross-Branch Feature Fusion
    Chen, Yujin
    Tu, Zhigang
    Kang, Di
    Chen, Ruizhi
    Bao, Linchao
    Zhang, Zhengyou
    Yuan, Junsong
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4008 - 4021
  • [8] A new image fusion performance metric based on visual information fidelity
    Han, Yu
    Cai, Yunze
    Cao, Yin
    Xu, Xiaoming
    [J]. INFORMATION FUSION, 2013, 14 (02) : 127 - 135
  • [9] Multi-focus image fusion combining focus-region-level partition and pulse-coupled neural network
    He, Kangjian
    Zhou, Dongming
    Zhang, Xuejie
    Nie, Rencan
    Jin, Xin
    [J]. SOFT COMPUTING, 2019, 23 (13) : 4685 - 4699
  • [10] Multi-focus: Focused region finding and multi-scale transform for image fusion
    He, Kangjian
    Zhou, Dongming
    Zhang, Xuejie
    Nie, Rencan
    [J]. NEUROCOMPUTING, 2018, 320 : 157 - 170