A fuzzy convolutional neural network for enhancing multi-focus image fusion

被引:28
|
作者
Bhalla, Kanika [1 ]
Koundal, Deepika [2 ]
Sharma, Bhisham [3 ]
Hu, Yu-Chen [4 ]
Zaguia, Atef [5 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn & Comp Sci, Taipei 10608, Taiwan
[2] Univ Petr & Energy Studies, Sch Comp Sci, Dept Syst, Dehra Dun, India
[3] Chitkara Univ, Chitkara Univ Sch Engn & Technol, Chandigarh, Himachal Prades, India
[4] Providence Univ, Dept Comp Sci & Informat Management, Taichung 43301, Taiwan
[5] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, PO BOX 11099, At Taif 21944, Saudi Arabia
关键词
Deep learning; Fusion; Fuzzy sets; Multi-focus images; ENHANCEMENT; ENSEMBLE;
D O I
10.1016/j.jvcir.2022.103485
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The images captured by the cameras contain distortions, misclassified pixels, uncertainties and poor contrast. Therefore, the multi-focus image fusion (MFIF) integrates various input image features to produce a single fused image using all its objects in focus. However, it is computationally complex, which leads to inconsistency. Hence, the MFIF method is employed to generate the fused image by integrating the fuzzy sets (FS) and convolutional neural network (CNN) to detect focused and unfocused parts in both source images. It is also compared with other competing six MFIF methods like Neutrosophic set based stationary wavelet transform (NSWT), guided filters, CNN, ensemble CNN, image fusion-based CNN and deep regression pair learning (DRPL). Benchmark datasets validate the superiority of the proposed FCNN method in terms of four non-reference assessment measures having mutual information (1.1678), edge information (0.7281), structural similarity (0.9850) and human perception (0.8020) and two reference metrics such as Peak signal-to-noise ratio (57.23) and root mean square error (1.814).
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Multi-focus image fusion algorithm based on supervised learning for fully convolutional neural network
    Li, Heng
    Zhang, Liming
    Jiang, Meirong
    Li, Yulong
    PATTERN RECOGNITION LETTERS, 2021, 141 (141) : 45 - 53
  • [22] Multi-focus image fusion using pixel level deep learning convolutional neural network
    Rout, Manmay
    Nahak, Siddheswar
    Priyadarshinee, Subhashree
    Santoshroy, Prasanti
    Sa, Kodanda Dhar
    Dash, Dillip
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICCS), 2019, : 582 - 586
  • [23] Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network
    Du, Chaoben
    Gao, Shesheng
    IEEE ACCESS, 2017, 5 : 15750 - 15761
  • [24] Fully Convolutional Networks for Multi-Focus Image Fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    2018 9TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2018, : 553 - 558
  • [25] Identification of overlapped wool/cashmere fibers based on multi-focus image fusion and convolutional neural network
    Zang, Liran
    Xin, Binjie
    Deng, Na
    JOURNAL OF NATURAL FIBERS, 2022, 19 (13) : 6715 - 6726
  • [26] DCKN: Multi-focus image fusion via dynamic convolutional kernel network
    Duan, Zhao
    Zhang, Taiping
    Luo, Xiaoliu
    Tan, Jin
    SIGNAL PROCESSING, 2021, 189
  • [27] A multi-channel neural network model for multi-focus image fusion
    Qi, Yunliang
    Yang, Zhen
    Lu, Xiangyu
    Li, Shouliang
    Ma, Yide
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 247
  • [28] Multi-focus image fusion using pulse coupled neural network
    Huang, Wei
    Jing, Zhongliang
    PATTERN RECOGNITION LETTERS, 2007, 28 (09) : 1123 - 1132
  • [29] Multi-Focus Image Fusion Using Fuzzy Logic
    Chamankar, Amaj
    Sheikhan, Mansour
    Razaghian, Farhad
    2013 13TH IRANIAN CONFERENCE ON FUZZY SYSTEMS (IFSC), 2013,
  • [30] Multi-focus image fusion based on fully convolutional networks
    Guo, Rui
    Shen, Xuan-jing
    Dong, Xiao-yu
    Zhang, Xiao-li
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2020, 21 (07) : 1019 - 1033