A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusion

被引:3
|
作者
Aymaz, Samet [1 ]
Kose, Cemal [1 ]
Aymaz, Seyma [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, Trabzon, Turkey
关键词
Multi-focus; Image fusion; Deep learning; Focus metrics; CNN; ALGORITHM; TRANSFORM; FRAMEWORK; NETWORKS; WAVELET;
D O I
10.1007/s11042-022-13323-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion merges multiple source images of the same scene with different focus values to obtain a single image that is more informative. A novel approach is proposed to create this single image in this paper. The method's primary stages include creating initial decision maps, applying morphological operations, and obtaining the fused image with the created fusion rule. Initial decision maps consist of label values represented as focused or non-focused. While determining these values, the first decision is made by feeding the image patches obtained from each source image to the modified CNN architecture. If the modified CNN architecture is unstable in determining label values, a new improvement mechanism designed based on focus measurements is applied for unstable regions where each image patch is labelled as non-focused. Then, the initial decision maps obtained for each source image are improved by morphological operations. Finally, the dynamic decision mechanism (DDM) fusion rule, designed considering the label values in the decision maps, is applied to minimize the disinformation resulting from classification errors in the fused image. At the end of all these steps, the final fused image is obtained. Also, in the article, a rich dataset containing two or more than two source images for each scene is created based on the COCO dataset. As a result, the method's success is measured with the help of objective and subjective metrics. When the visual and quantitative results are examined, it is proven that the proposed method successfully creates a perfect fused image.
引用
收藏
页码:1821 / 1871
页数:51
相关论文
共 50 条
  • [41] Convolutional Neural Network Based Multi-Focus Image Fusion
    Li, Huaguang
    Nie, Rencan
    Zhou, Dongming
    Gou, Xiaopeng
    PROCEEDINGS OF THE 2018 2ND INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS (ICACS 2018), 2018, : 148 - 154
  • [42] Multi-focus image fusion through pixel-wise voting and morphology
    Luo, Huibin
    U, KinTak
    Zhao, Weikang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (01) : 899 - 925
  • [43] Image matting for fusion of multi-focus images in dynamic scenes
    Li, Shutao
    Kang, Xudong
    Hu, Jianwen
    Yang, Bin
    INFORMATION FUSION, 2013, 14 (02) : 147 - 162
  • [44] Improved Multi-Focus Image Fusion
    Jameel, Amina
    Noor, Fouzia
    2015 18TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2015, : 1346 - 1352
  • [45] DCKN: Multi-focus image fusion via dynamic convolutional kernel network
    Duan, Zhao
    Zhang, Taiping
    Luo, Xiaoliu
    Tan, Jin
    SIGNAL PROCESSING, 2021, 189
  • [46] A multi-focus image fusion new method based on multi-decision
    Wang Yajie
    Xu Xinhe
    SIGNAL ANALYSIS, MEASUREMENT THEORY, PHOTO-ELECTRONIC TECHNOLOGY, AND ARTIFICIAL INTELLIGENCE, PTS 1 AND 2, 2006, 6357
  • [47] A novel sparse representation based fusion approach for multi-focus images
    Tang, Dan
    Xiong, Qingyu
    Yin, Hongpeng
    Zhu, Zhiqin
    Li, Yanxia
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 197
  • [48] MULTI-FOCUS IMAGE FUSION VIA COUPLED DICTIONARY TRAINING
    Gao, Rui
    Vorobyov, Sergiy A.
    Zhao, Hong
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1666 - 1670
  • [49] Multi-focus Image Fusion Using Local Structure Features with Dynamic Windows
    Liu, Chen-Chung
    Lin, Hsin-Lei
    Yu, Shry-Shen
    2015 12TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD), 2015, : 1711 - 1715
  • [50] Robust multi-focus image fusion using focus property detection and deep image matting
    Wang, Changcheng
    Zang, Yongsheng
    Zhou, Dongming
    Mei, Jiatian
    Nie, Rencan
    Zhou, Lifen
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237