A fuzzy convolutional neural network for enhancing multi-focus image fusion

被引:28
作者
Bhalla, Kanika [1 ]
Koundal, Deepika [2 ]
Sharma, Bhisham [3 ]
Hu, Yu-Chen [4 ]
Zaguia, Atef [5 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn & Comp Sci, Taipei 10608, Taiwan
[2] Univ Petr & Energy Studies, Sch Comp Sci, Dept Syst, Dehra Dun, India
[3] Chitkara Univ, Chitkara Univ Sch Engn & Technol, Chandigarh, Himachal Prades, India
[4] Providence Univ, Dept Comp Sci & Informat Management, Taichung 43301, Taiwan
[5] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, PO BOX 11099, At Taif 21944, Saudi Arabia
关键词
Deep learning; Fusion; Fuzzy sets; Multi-focus images; ENHANCEMENT; ENSEMBLE;
D O I
10.1016/j.jvcir.2022.103485
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The images captured by the cameras contain distortions, misclassified pixels, uncertainties and poor contrast. Therefore, the multi-focus image fusion (MFIF) integrates various input image features to produce a single fused image using all its objects in focus. However, it is computationally complex, which leads to inconsistency. Hence, the MFIF method is employed to generate the fused image by integrating the fuzzy sets (FS) and convolutional neural network (CNN) to detect focused and unfocused parts in both source images. It is also compared with other competing six MFIF methods like Neutrosophic set based stationary wavelet transform (NSWT), guided filters, CNN, ensemble CNN, image fusion-based CNN and deep regression pair learning (DRPL). Benchmark datasets validate the superiority of the proposed FCNN method in terms of four non-reference assessment measures having mutual information (1.1678), edge information (0.7281), structural similarity (0.9850) and human perception (0.8020) and two reference metrics such as Peak signal-to-noise ratio (57.23) and root mean square error (1.814).
引用
收藏
页数:16
相关论文
共 49 条
  • [1] A local fuzzy thresholding methodology for multiregion image segmentation
    Aja-Fernandez, Santiago
    Hernan Curiale, Ariel
    Vegas-Sanchez-Ferrero, Gonzalo
    [J]. KNOWLEDGE-BASED SYSTEMS, 2015, 83 : 1 - 12
  • [2] Ensemble of CNN for multi-focus image fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    [J]. INFORMATION FUSION, 2019, 51 : 201 - 214
  • [3] Bhalla Kanika, 2021, 2021 International Conference on System Science and Engineering (ICSSE), P328, DOI 10.1109/ICSSE52999.2021.9538470
  • [4] Fusion of Infrared and Visible Images Using Fuzzy Based Siamese Convolutional Network
    Bhalla, Kanika
    Koundal, Deepika
    Bhatia, Surbhi
    Rahmani, Mohammad Khalid Imam
    Tahir, Muhammad
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (03): : 5503 - 5518
  • [5] Bhalla K, 2019, PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), P535
  • [6] Multi-focus Image Fusion using Neutrosophic based Wavelet Transform
    Bhat, Shiveta
    Koundal, Deepika
    [J]. APPLIED SOFT COMPUTING, 2021, 106
  • [7] Multi-focus image fusion techniques: a survey
    Bhat, Shiveta
    Koundal, Deepika
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (08) : 5735 - 5787
  • [8] Enhancement of dronogram aid to visual interpretation of target objects via intuitionistic fuzzy hesitant sets
    Biswas, Biswajit
    Bhattacharyya, Siddhartha
    Platos, Jan
    Snasel, Vaclav
    [J]. INFORMATION SCIENCES, 2019, 500 : 67 - 86
  • [9] Feature transfer method for infrared and visible image fusion via fuzzy lifting scheme
    Dai, Liyang
    Liu, Gang
    Huang, Lei
    Xiao, Gang
    Xu, Zhao
    Ruan, Junjin
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2021, 114
  • [10] Complete image fusion method based on fuzzy transforms
    Di Martino, Ferdinando
    Sessa, Salvatore
    [J]. SOFT COMPUTING, 2019, 23 (06) : 2113 - 2123