A fuzzy convolutional neural network for enhancing multi-focus image fusion

被引:28
|
作者
Bhalla, Kanika [1 ]
Koundal, Deepika [2 ]
Sharma, Bhisham [3 ]
Hu, Yu-Chen [4 ]
Zaguia, Atef [5 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn & Comp Sci, Taipei 10608, Taiwan
[2] Univ Petr & Energy Studies, Sch Comp Sci, Dept Syst, Dehra Dun, India
[3] Chitkara Univ, Chitkara Univ Sch Engn & Technol, Chandigarh, Himachal Prades, India
[4] Providence Univ, Dept Comp Sci & Informat Management, Taichung 43301, Taiwan
[5] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, PO BOX 11099, At Taif 21944, Saudi Arabia
关键词
Deep learning; Fusion; Fuzzy sets; Multi-focus images; ENHANCEMENT; ENSEMBLE;
D O I
10.1016/j.jvcir.2022.103485
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The images captured by the cameras contain distortions, misclassified pixels, uncertainties and poor contrast. Therefore, the multi-focus image fusion (MFIF) integrates various input image features to produce a single fused image using all its objects in focus. However, it is computationally complex, which leads to inconsistency. Hence, the MFIF method is employed to generate the fused image by integrating the fuzzy sets (FS) and convolutional neural network (CNN) to detect focused and unfocused parts in both source images. It is also compared with other competing six MFIF methods like Neutrosophic set based stationary wavelet transform (NSWT), guided filters, CNN, ensemble CNN, image fusion-based CNN and deep regression pair learning (DRPL). Benchmark datasets validate the superiority of the proposed FCNN method in terms of four non-reference assessment measures having mutual information (1.1678), edge information (0.7281), structural similarity (0.9850) and human perception (0.8020) and two reference metrics such as Peak signal-to-noise ratio (57.23) and root mean square error (1.814).
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Multi-focus image fusion based on fully convolutional networks
    Rui Guo
    Xuan-jing Shen
    Xiao-yu Dong
    Xiao-li Zhang
    Frontiers of Information Technology & Electronic Engineering, 2020, 21 : 1019 - 1033
  • [32] BOUNDARY AWARE MULTI-FOCUS IMAGE FUSION USING DEEP NEURAL NETWORK
    Ma, Haoyu
    Zhang, Juncheng
    Liu, Shaojun
    Liao, Qingmin
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1150 - 1155
  • [33] LNMF: lightweight network for multi-focus image fusion
    Zhou, Yang
    Liu, Kai
    Dou, Qingyu
    Liu, Zitao
    Jeon, Gwanggil
    Yang, Xiaomin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (16) : 22335 - 22353
  • [34] Multi-Focus Image Fusion With a Natural Enhancement via a Joint Multi-Level Deeply Supervised Convolutional Neural Network
    Zhao, Wenda
    Wang, Dong
    Lu, Huchuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (04) : 1102 - 1115
  • [35] LNMF: lightweight network for multi-focus image fusion
    Yang Zhou
    Kai Liu
    Qingyu Dou
    Zitao Liu
    Gwanggil Jeon
    Xiaomin Yang
    Multimedia Tools and Applications, 2022, 81 : 22335 - 22353
  • [36] Technique for multi-focus image fusion based on fuzzy-adaptive pulse-coupled neural network
    Yong Yang
    Yue Que
    Shu-Ying Huang
    Pan Lin
    Signal, Image and Video Processing, 2017, 11 : 439 - 446
  • [37] Technique for multi-focus image fusion based on fuzzy-adaptive pulse-coupled neural network
    Yang, Yong
    Que, Yue
    Huang, Shu-Ying
    Lin, Pan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (03) : 439 - 446
  • [38] Multi-focus image fusion for enhancing fiber microscopic images
    Wang, RongWu
    Xu, Bugao
    Zeng, Peifeng
    Zhang, Xianmiao
    TEXTILE RESEARCH JOURNAL, 2012, 82 (04) : 352 - 361
  • [39] Multi-Focus Image Fusion Algorithm Based on Supervised Learning for Fully Convolutional Neural Networks
    Li Heng
    Zhang Liming
    Jiang Meirong
    Li Yulong
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (08)
  • [40] Multi-focus Image Fusion Based on Fuzzy and Wavelet Transform
    Saeedi, Jamal
    Faez, Karim
    Mozaffari, Saeed
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, PROCEEDINGS, 2009, 5856 : 970 - +