A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusion

被引:3
|
作者
Aymaz, Samet [1 ]
Kose, Cemal [1 ]
Aymaz, Seyma [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, Trabzon, Turkey
关键词
Multi-focus; Image fusion; Deep learning; Focus metrics; CNN; ALGORITHM; TRANSFORM; FRAMEWORK; NETWORKS; WAVELET;
D O I
10.1007/s11042-022-13323-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion merges multiple source images of the same scene with different focus values to obtain a single image that is more informative. A novel approach is proposed to create this single image in this paper. The method's primary stages include creating initial decision maps, applying morphological operations, and obtaining the fused image with the created fusion rule. Initial decision maps consist of label values represented as focused or non-focused. While determining these values, the first decision is made by feeding the image patches obtained from each source image to the modified CNN architecture. If the modified CNN architecture is unstable in determining label values, a new improvement mechanism designed based on focus measurements is applied for unstable regions where each image patch is labelled as non-focused. Then, the initial decision maps obtained for each source image are improved by morphological operations. Finally, the dynamic decision mechanism (DDM) fusion rule, designed considering the label values in the decision maps, is applied to minimize the disinformation resulting from classification errors in the fused image. At the end of all these steps, the final fused image is obtained. Also, in the article, a rich dataset containing two or more than two source images for each scene is created based on the COCO dataset. As a result, the method's success is measured with the help of objective and subjective metrics. When the visual and quantitative results are examined, it is proven that the proposed method successfully creates a perfect fused image.
引用
收藏
页码:1821 / 1871
页数:51
相关论文
共 50 条
  • [21] Fully Convolutional Networks for Multi-Focus Image Fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    2018 9TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2018, : 553 - 558
  • [22] CNNs hard voting for multi-focus image fusion
    Mostafa Amin-Naji
    Ali Aghagolzadeh
    Mehdi Ezoji
    Journal of Ambient Intelligence and Humanized Computing, 2020, 11 : 1749 - 1769
  • [23] DMDN: Degradation model-based deep network for multi-focus image fusion
    Xiao, Yifan
    Guo, Zhixin
    Veelaert, Peter
    Philips, Wilfried
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 101
  • [24] CNNs hard voting for multi-focus image fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 11 (04) : 1749 - 1769
  • [25] Depth-Distilled Multi-Focus Image Fusion
    Zhao, Fan
    Zhao, Wenda
    Lu, Huimin
    Liu, Yong
    Yao, Libo
    Liu, Yu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 966 - 978
  • [26] MULTI-FOCUS IMAGE FUSION USING WAVELET-DOMAIN STATISTICS
    Tian, Jing
    Chen, Li
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 1205 - 1208
  • [27] Conditional Random Field-Guided Multi-Focus Image Fusion
    Bouzos, Odysseas
    Andreadis, Ioannis
    Mitianoudis, Nikolaos
    JOURNAL OF IMAGING, 2022, 8 (09)
  • [28] Multi-focus image fusion approach based on CNP systems in NSCT domain
    Peng, Hong
    Li, Bo
    Yang, Qian
    Wang, Jun
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 210 (210)
  • [29] Multi-focus Image Fusion: Neural Network Approach
    Deshmukh, Vaidehi
    Chandsare, Aditi
    Gotmare, Vaishnavi
    Patil, Atul
    2017 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2017,
  • [30] DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion
    Li, Jinxing
    Guo, Xiaobao
    Lu, Guangming
    Zhang, Bob
    Xu, Yong
    Wu, Feng
    Zhang, David
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4816 - 4831