A fuzzy convolutional neural network for enhancing multi-focus image fusion

被引:28
|
作者
Bhalla, Kanika [1 ]
Koundal, Deepika [2 ]
Sharma, Bhisham [3 ]
Hu, Yu-Chen [4 ]
Zaguia, Atef [5 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn & Comp Sci, Taipei 10608, Taiwan
[2] Univ Petr & Energy Studies, Sch Comp Sci, Dept Syst, Dehra Dun, India
[3] Chitkara Univ, Chitkara Univ Sch Engn & Technol, Chandigarh, Himachal Prades, India
[4] Providence Univ, Dept Comp Sci & Informat Management, Taichung 43301, Taiwan
[5] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, PO BOX 11099, At Taif 21944, Saudi Arabia
关键词
Deep learning; Fusion; Fuzzy sets; Multi-focus images; ENHANCEMENT; ENSEMBLE;
D O I
10.1016/j.jvcir.2022.103485
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The images captured by the cameras contain distortions, misclassified pixels, uncertainties and poor contrast. Therefore, the multi-focus image fusion (MFIF) integrates various input image features to produce a single fused image using all its objects in focus. However, it is computationally complex, which leads to inconsistency. Hence, the MFIF method is employed to generate the fused image by integrating the fuzzy sets (FS) and convolutional neural network (CNN) to detect focused and unfocused parts in both source images. It is also compared with other competing six MFIF methods like Neutrosophic set based stationary wavelet transform (NSWT), guided filters, CNN, ensemble CNN, image fusion-based CNN and deep regression pair learning (DRPL). Benchmark datasets validate the superiority of the proposed FCNN method in terms of four non-reference assessment measures having mutual information (1.1678), edge information (0.7281), structural similarity (0.9850) and human perception (0.8020) and two reference metrics such as Peak signal-to-noise ratio (57.23) and root mean square error (1.814).
引用
收藏
页数:16
相关论文
共 50 条
  • [41] A Deep and Supervised Atrous Convolutional Model for Multi-Focus Image Fusion
    Wang, Changcheng
    Zhou, Dongming
    Zang, Yongsheng
    Nie, Rencan
    Guo, Yanbu
    IEEE SENSORS JOURNAL, 2021, 21 (20) : 23069 - 23084
  • [42] Multi-focus image fusion via online convolutional sparse coding
    Zhang, Chengfang
    Zhang, Ziyou
    Li, Haoyue
    He, Sidi
    Feng, Ziliang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 17327 - 17356
  • [43] Unfolding coupled convolutional sparse representation for multi-focus image fusion
    Zheng, Kecheng
    Cheng, Juan
    Liu, Yu
    INFORMATION FUSION, 2025, 118
  • [44] Multi-focus image fusion via online convolutional sparse coding
    Chengfang Zhang
    Ziyou Zhang
    Haoyue Li
    Sidi He
    Ziliang Feng
    Multimedia Tools and Applications, 2024, 83 : 17327 - 17356
  • [45] A novel pulse coupled neural network based method for multi-focus image fusion
    Zhang, Yongxin
    Chen, Li
    Zhao, Zhihua
    Jia, Jian
    1600, Science and Engineering Research Support Society (07): : 361 - 369
  • [46] Multi-focus image fusion method using energy of Laplacian and a deep neural network
    Zhai, Hao
    Zhuang, Yi
    Applied Optics, 2020, 59 (06): : 1684 - 1694
  • [47] Multi-focus image fusion method using energy of Laplacian and a deep neural network
    Zhai, Hao
    Zhuang, Yi
    APPLIED OPTICS, 2020, 59 (06) : 1684 - 1694
  • [48] A Convolutional Neural Network-Based Conditional Random Field Model for Structured Multi-Focus Image Fusion Robust to Noise
    Bouzos, Odysseas
    Andreadis, Ioannis
    Mitianoudis, Nikolaos
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2915 - 2930
  • [49] Multi-focus Image Fusion Using Deep Belief Network
    Deshmukh, Vaidehi
    Khaparde, Arti
    Shaikh, Sana
    INFORMATION AND COMMUNICATION TECHNOLOGY FOR INTELLIGENT SYSTEMS (ICTIS 2017) - VOL 1, 2018, 83 : 233 - 241
  • [50] Multi-Focus Image Fusion Based on Generative Adversarial Network
    Jiang L.
    Zhang D.
    Pan B.
    Zheng P.
    Che L.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (11): : 1715 - 1725