A fuzzy convolutional neural network for enhancing multi-focus image fusion

被引:32
作者
Bhalla, Kanika [1 ]
Koundal, Deepika [2 ]
Sharma, Bhisham [3 ]
Hu, Yu-Chen [4 ]
Zaguia, Atef [5 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn & Comp Sci, Taipei 10608, Taiwan
[2] Univ Petr & Energy Studies, Sch Comp Sci, Dept Syst, Dehra Dun, India
[3] Chitkara Univ, Chitkara Univ Sch Engn & Technol, Chandigarh, Himachal Prades, India
[4] Providence Univ, Dept Comp Sci & Informat Management, Taichung 43301, Taiwan
[5] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, PO BOX 11099, At Taif 21944, Saudi Arabia
关键词
Deep learning; Fusion; Fuzzy sets; Multi-focus images; ENHANCEMENT; ENSEMBLE;
D O I
10.1016/j.jvcir.2022.103485
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The images captured by the cameras contain distortions, misclassified pixels, uncertainties and poor contrast. Therefore, the multi-focus image fusion (MFIF) integrates various input image features to produce a single fused image using all its objects in focus. However, it is computationally complex, which leads to inconsistency. Hence, the MFIF method is employed to generate the fused image by integrating the fuzzy sets (FS) and convolutional neural network (CNN) to detect focused and unfocused parts in both source images. It is also compared with other competing six MFIF methods like Neutrosophic set based stationary wavelet transform (NSWT), guided filters, CNN, ensemble CNN, image fusion-based CNN and deep regression pair learning (DRPL). Benchmark datasets validate the superiority of the proposed FCNN method in terms of four non-reference assessment measures having mutual information (1.1678), edge information (0.7281), structural similarity (0.9850) and human perception (0.8020) and two reference metrics such as Peak signal-to-noise ratio (57.23) and root mean square error (1.814).
引用
收藏
页数:16
相关论文
共 49 条
[1]   A local fuzzy thresholding methodology for multiregion image segmentation [J].
Aja-Fernandez, Santiago ;
Hernan Curiale, Ariel ;
Vegas-Sanchez-Ferrero, Gonzalo .
KNOWLEDGE-BASED SYSTEMS, 2015, 83 :1-12
[2]   Ensemble of CNN for multi-focus image fusion [J].
Amin-Naji, Mostafa ;
Aghagolzadeh, Ali ;
Ezoji, Mehdi .
INFORMATION FUSION, 2019, 51 :201-214
[3]  
Bhalla Kanika, 2021, 2021 International Conference on System Science and Engineering (ICSSE), P328, DOI 10.1109/ICSSE52999.2021.9538470
[4]   Fusion of Infrared and Visible Images Using Fuzzy Based Siamese Convolutional Network [J].
Bhalla, Kanika ;
Koundal, Deepika ;
Bhatia, Surbhi ;
Rahmani, Mohammad Khalid Imam ;
Tahir, Muhammad .
CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (03) :5503-5518
[5]  
Bhalla K, 2019, PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), P535
[6]   Multi-focus Image Fusion using Neutrosophic based Wavelet Transform [J].
Bhat, Shiveta ;
Koundal, Deepika .
APPLIED SOFT COMPUTING, 2021, 106
[7]   Multi-focus image fusion techniques: a survey [J].
Bhat, Shiveta ;
Koundal, Deepika .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (08) :5735-5787
[8]   Enhancement of dronogram aid to visual interpretation of target objects via intuitionistic fuzzy hesitant sets [J].
Biswas, Biswajit ;
Bhattacharyya, Siddhartha ;
Platos, Jan ;
Snasel, Vaclav .
INFORMATION SCIENCES, 2019, 500 :67-86
[9]   Feature transfer method for infrared and visible image fusion via fuzzy lifting scheme [J].
Dai, Liyang ;
Liu, Gang ;
Huang, Lei ;
Xiao, Gang ;
Xu, Zhao ;
Ruan, Junjin .
INFRARED PHYSICS & TECHNOLOGY, 2021, 114
[10]   Complete image fusion method based on fuzzy transforms [J].
Di Martino, Ferdinando ;
Sessa, Salvatore .
SOFT COMPUTING, 2019, 23 (06) :2113-2123