A fuzzy convolutional neural network for enhancing multi-focus image fusion

被引:28
|
作者
Bhalla, Kanika [1 ]
Koundal, Deepika [2 ]
Sharma, Bhisham [3 ]
Hu, Yu-Chen [4 ]
Zaguia, Atef [5 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn & Comp Sci, Taipei 10608, Taiwan
[2] Univ Petr & Energy Studies, Sch Comp Sci, Dept Syst, Dehra Dun, India
[3] Chitkara Univ, Chitkara Univ Sch Engn & Technol, Chandigarh, Himachal Prades, India
[4] Providence Univ, Dept Comp Sci & Informat Management, Taichung 43301, Taiwan
[5] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, PO BOX 11099, At Taif 21944, Saudi Arabia
关键词
Deep learning; Fusion; Fuzzy sets; Multi-focus images; ENHANCEMENT; ENSEMBLE;
D O I
10.1016/j.jvcir.2022.103485
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The images captured by the cameras contain distortions, misclassified pixels, uncertainties and poor contrast. Therefore, the multi-focus image fusion (MFIF) integrates various input image features to produce a single fused image using all its objects in focus. However, it is computationally complex, which leads to inconsistency. Hence, the MFIF method is employed to generate the fused image by integrating the fuzzy sets (FS) and convolutional neural network (CNN) to detect focused and unfocused parts in both source images. It is also compared with other competing six MFIF methods like Neutrosophic set based stationary wavelet transform (NSWT), guided filters, CNN, ensemble CNN, image fusion-based CNN and deep regression pair learning (DRPL). Benchmark datasets validate the superiority of the proposed FCNN method in terms of four non-reference assessment measures having mutual information (1.1678), edge information (0.7281), structural similarity (0.9850) and human perception (0.8020) and two reference metrics such as Peak signal-to-noise ratio (57.23) and root mean square error (1.814).
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Multi-focus image fusion with the all convolutional neural network
    Du C.-B.
    Gao S.-S.
    Optoelectronics Letters, 2018, 14 (1) : 71 - 75
  • [2] Multi-focus image fusion with the all convolutional neural network
    杜超本
    高社生
    Optoelectronics Letters, 2018, 14 (01) : 71 - 75
  • [3] Multi-focus image fusion with a deep convolutional neural network
    Liu, Yu
    Chen, Xun
    Peng, Hu
    Wang, Zengfu
    INFORMATION FUSION, 2017, 36 : 191 - 207
  • [4] Convolutional Neural Network Based Multi-Focus Image Fusion
    Li, Huaguang
    Nie, Rencan
    Zhou, Dongming
    Gou, Xiaopeng
    PROCEEDINGS OF THE 2018 2ND INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS (ICACS 2018), 2018, : 148 - 154
  • [5] Pixel convolutional neural network for multi-focus image fusion
    Tang, Han
    Xiao, Bin
    Li, Weisheng
    Wang, Guoyin
    INFORMATION SCIENCES, 2018, 433 : 125 - 141
  • [6] Multi-scale convolutional neural network for multi-focus image fusion
    Mustafa, Hafiz Tayyab
    Yang, Jie
    Zareapoor, Masoumeh
    IMAGE AND VISION COMPUTING, 2019, 85 : 26 - 35
  • [7] Pyramid Pooling Dense Convolutional Neural Network for Multi-focus image Fusion
    Li, Yi
    Shen, Xuanjing
    Chen, Haipeng
    PROCEEDINGS OF 2019 6TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2019, : 164 - 168
  • [8] Multi-focus image fusion and super-resolution with convolutional neural network
    Yang, Bin
    Zhong, Jinying
    Li, Yuehua
    Chen, Zhongze
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2017, 15 (04)
  • [9] Dense Multi-focus Fusion Net: A Deep Unsupervised Convolutional Network for Multi-focus Image Fusion
    Mustafa, Hafiz Tayyab
    Liu, Fanghui
    Yang, Jie
    Khan, Zubair
    Huang, Qiao
    ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 153 - 163
  • [10] Multi-focus Image Fusion: Neural Network Approach
    Deshmukh, Vaidehi
    Chandsare, Aditi
    Gotmare, Vaishnavi
    Patil, Atul
    2017 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2017,