A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusion

被引:3
|
作者
Aymaz, Samet [1 ]
Kose, Cemal [1 ]
Aymaz, Seyma [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, Trabzon, Turkey
关键词
Multi-focus; Image fusion; Deep learning; Focus metrics; CNN; ALGORITHM; TRANSFORM; FRAMEWORK; NETWORKS; WAVELET;
D O I
10.1007/s11042-022-13323-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion merges multiple source images of the same scene with different focus values to obtain a single image that is more informative. A novel approach is proposed to create this single image in this paper. The method's primary stages include creating initial decision maps, applying morphological operations, and obtaining the fused image with the created fusion rule. Initial decision maps consist of label values represented as focused or non-focused. While determining these values, the first decision is made by feeding the image patches obtained from each source image to the modified CNN architecture. If the modified CNN architecture is unstable in determining label values, a new improvement mechanism designed based on focus measurements is applied for unstable regions where each image patch is labelled as non-focused. Then, the initial decision maps obtained for each source image are improved by morphological operations. Finally, the dynamic decision mechanism (DDM) fusion rule, designed considering the label values in the decision maps, is applied to minimize the disinformation resulting from classification errors in the fused image. At the end of all these steps, the final fused image is obtained. Also, in the article, a rich dataset containing two or more than two source images for each scene is created based on the COCO dataset. As a result, the method's success is measured with the help of objective and subjective metrics. When the visual and quantitative results are examined, it is proven that the proposed method successfully creates a perfect fused image.
引用
收藏
页码:1821 / 1871
页数:51
相关论文
共 50 条
  • [31] A novel sparse-representation-based multi-focus image fusion approach
    Yin, Hongpeng
    Li, Yanxia
    Chai, Yi
    Liu, Zhaodong
    Zhu, Zhiqin
    NEUROCOMPUTING, 2016, 216 : 216 - 229
  • [32] Evaluation of focus measures in multi-focus image fusion
    Huang, Wei
    Jing, Zhongliang
    PATTERN RECOGNITION LETTERS, 2007, 28 (04) : 493 - 500
  • [33] Multiscale Image Matting Based Multi-Focus Image Fusion Technique
    Maqsood, Sarmad
    Javed, Umer
    Riaz, Muhammad Mohsin
    Muzammil, Muhammad
    Muhammad, Fazal
    Kim, Sunghwan
    ELECTRONICS, 2020, 9 (03)
  • [34] Robust Multi-Focus Image Fusion Using Edge Model and Multi-Matting
    Chen, Yibo
    Guan, Jingwei
    Cham, Wai-Kuen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) : 1526 - 1541
  • [35] Survey on Multi-Focus Image Fusion Algorithms
    Garg, Rishu
    Gupta, Preeti
    Kaur, Harvinder
    2014 RECENT ADVANCES IN ENGINEERING AND COMPUTATIONAL SCIENCES (RAECS), 2014,
  • [36] Novel multi-focus image fusion based on PCNN and random walks
    Wang, Zhaobin
    Wang, Shuai
    Guo, Lijie
    NEURAL COMPUTING & APPLICATIONS, 2018, 29 (11) : 1101 - 1114
  • [37] Ensemble of CNN for multi-focus image fusion
    Amin-Naji, Mostafa
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    INFORMATION FUSION, 2019, 51 : 201 - 214
  • [38] Adaptive multi-focus image fusion using a wavelet-based statistical sharpness measure
    Tian, Jing
    Chen, Li
    SIGNAL PROCESSING, 2012, 92 (09) : 2137 - 2146
  • [39] Multi-focus image fusion techniques: a survey
    Shiveta Bhat
    Deepika Koundal
    Artificial Intelligence Review, 2021, 54 : 5735 - 5787
  • [40] Multi-focus image fusion using HOSVD and edge intensity
    Luo, Xiaoqing
    Zhang, Zhancheng
    Zhang, Cuiying
    Wu, Xiaojun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 45 : 46 - 61