Multifocus image fusion using convolutional neural network

被引:13
|
作者
Wen, Yu [1 ]
Yang, Xiaomin [1 ]
Celik, Turgay [2 ]
Sushkova, Olga [3 ]
Albertini, Marcelo Keese [4 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610064, Sichuan, Peoples R China
[2] Univ Witwatersrand, Sch Comp Sci & Appl Math, Johannesburg, South Africa
[3] Kotelnikov Inst Radio Engn & Elect, Moscow, Russia
[4] Univ Fed Uberlandia, Dept Comp Sci, Uberlandia, MG, Brazil
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-focus; Convolutional neural network; Morphological filtering; PERFORMANCE;
D O I
10.1007/s11042-020-08945-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Acquiring all-in-focus images is significant in the multi-media era. Limited by the depth-of-field of the optical lens, it is hard to acquire an image with all targets are clear. One possible solution is to merge the information of a few complementary images in the same scene. In this article, we employ a two-channel convolutional network to derive the clarity map of source images. Then, the clarity map is smoothed by using morphological filtering. Finally, the fusion image is constructed via merging the clear parts of source images. Experimental results prove that our approach has a better performance on both visual quality and quantitative evaluations than many previous fusion approaches.
引用
收藏
页码:34531 / 34543
页数:13
相关论文
共 50 条
  • [21] BCNN: An Effective Multifocus Image fusion Method Based on the Hierarchical Bayesian and Convolutional Neural Networks
    Liu, ChunXiang
    Wang, Yuwei
    Wang, Lei
    Cheng, Tianqi
    Guo, Xinping
    AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2024, 58 (02) : 166 - 176
  • [22] Multifocus image fusion using contourlet
    Li, ST
    ISTM/2005: 6TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-9, CONFERENCE PROCEEDINGS, 2005, : 6358 - 6361
  • [23] Remote Sensing Image Fusion with Convolutional Neural Network
    Zhong J.
    Yang B.
    Huang G.
    Zhong F.
    Chen Z.
    Sensing and Imaging, 2016, 17 (1):
  • [24] Internet street view image fusion method using convolutional neural network
    Chen, Jing
    Wang, Xiaoxuan
    Wu, Yujing
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2024, 24 (03) : 1665 - 1678
  • [25] Image-based Kinship Verification using Fusion Convolutional Neural Network
    Rachmadi, Reza Fuad
    Purnama, I. Ketut Eddy
    Nugroho, Supeno Mardi Susiki
    Suprapto, Yoyon Kusnendar
    2019 IEEE 11TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL INTELLIGENCE AND APPLICATIONS (IWCIA 2019), 2019, : 59 - 65
  • [26] Video super resolution using convolutional neural network and image fusion techniques
    Kumar, Vikas
    Choudhury, Tanupriya
    Satapathy, Suresh Chandra
    Tomar, Ravi
    Aggarwal, Archit
    INTERNATIONAL JOURNAL OF KNOWLEDGE-BASED AND INTELLIGENT ENGINEERING SYSTEMS, 2020, 24 (04) : 279 - 287
  • [27] Multiscale Feature Interactive Network for Multifocus Image Fusion
    Liu, Yu
    Wang, Lei
    Cheng, Juan
    Chen, Xun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [28] Multiscale Feature Interactive Network for Multifocus Image Fusion
    Liu, Yu
    Wang, Lei
    Cheng, Juan
    Chen, Xun
    IEEE Transactions on Instrumentation and Measurement, 2021, 70
  • [29] Multifocus image fusion using phase congruency
    Zhan, Kun
    Li, Qiaoqiao
    Teng, Jicai
    Wang, Mingying
    Shi, Jinhui
    JOURNAL OF ELECTRONIC IMAGING, 2015, 24 (03)
  • [30] Multifocus image fusion using Zernike moments
    Toxqui-Quitl, C.
    Velazquez-Ramirez, E.
    Padilla-Vivanco, A.
    Solis-Villarreal, J.
    Santiago-Tepantlan, C.
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXV, 2012, 8499