The automatic focus segmentation of multi-focus image fusion

被引:3
|
作者
Hawari, K. [1 ,2 ]
Ismail [1 ]
机构
[1] Univ Malaysia Pahang, Fac Elect & Elect Engn, Kuantan 26300, Malaysia
[2] Politekn Negeri Padang, Elect Engn Dept, Padang 25162, Indonesia
关键词
deep learning; ResNet50; multi-focus image fusion; SCHEME;
D O I
10.24425/bpasts.2022.140352
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Multi-focus image fusion is a method of increasing the image quality and preventing image redundancy. It is utilized in many fields such as medical diagnostic, surveillance, and remote sensing. There are various algorithms available nowadays. However, a common problem is still there, i.e. the method is not sufficient to handle the ghost effect and unpredicted noises. Computational intelligence has developed quickly over recent decades, followed by the rapid development of multi-focus image fusion. The proposed method is multi-focus image fusion based on an automatic encoder-decoder algorithm. It uses deeplabV3+ architecture. During the training process, it uses a multi-focus dataset and ground truth. Then, the model of the network is constructed through the training process. This model was adopted in the testing process of sets to predict the focus map. The testing process is semantic focus processing. Lastly, the fusion process involves a focus map and multi-focus images to configure the fused image. The results show that the fused images do not contain any ghost effects or any unpredicted tiny objects. The assessment metric of the proposed method uses two aspects. The first is the accuracy of predicting a focus map, the second is an objective assessment of the fused image such as mutual information, SSIM, and PSNR indexes. They show a high score of precision and recall. In addition, the indexes of SSIM, PSNR, and mutual information are high. The proposed method also has more stable performance compared with other methods. Finally, the Resnet50 model algorithm in multi-focus image fusion can handle the ghost effect problem well.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Multi-focus image fusion based on region segmentation
    Jia-Zheng, Yuan
    Qing, Li
    Bo-Xuan, Sun
    Telkomnika - Indonesian Journal of Electrical Engineering, 2013, 11 (11): : 6722 - 6727
  • [2] Fusion PSPnet Image Segmentation Based Method for Multi-Focus Image Fusion
    Zhou, Jingchun
    Hao, Mingliang
    Zhang, Dehuan
    Zou, Peiyu
    Zhang, Weishi
    IEEE PHOTONICS JOURNAL, 2019, 11 (06):
  • [3] Multi-focus image fusion based on fast region segmentation
    Chen, Yang
    Qin, Zheng
    Hu, Hao
    Song, Mingyue
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2010, 50 (10): : 1733 - 1737
  • [4] Evaluation of focus measures in multi-focus image fusion
    Huang, Wei
    Jing, Zhongliang
    PATTERN RECOGNITION LETTERS, 2007, 28 (04) : 493 - 500
  • [5] Improved Multi-Focus Image Fusion
    Jameel, Amina
    Noor, Fouzia
    2015 18TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2015, : 1346 - 1352
  • [6] A Multi-focus Image Fusion Classifier
    Siddiqui, Abdul Basit
    Rashid, Muhammad
    Jaffar, M. Arfan
    Hussain, Ayyaz
    Mirza, Anwar M.
    INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2012, 15 (04): : 1757 - 1764
  • [7] Multi-focus thermal image fusion
    Benes, Radek
    Dvorak, Pavel
    Faundez-Zanuy, Marcos
    Espinosa-Duro, Virginia
    Mekyska, Jiri
    PATTERN RECOGNITION LETTERS, 2013, 34 (05) : 536 - 544
  • [8] A multi-focus image fusion method based on watershed segmentation and IHS image fusion
    Rashwan, Shaheera
    Youssef, Amira
    Youssef, Bayumy A. B.
    INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2021, 12 (02) : 176 - 184
  • [9] Image registration for multi-focus image fusion
    Zhang, Z
    Blum, RS
    BATTLESPACE DIGITIZATION AND NETWORK-CENTRIC WARFARE, 2001, 4396 : 279 - 290
  • [10] Dense Multi-focus Fusion Net: A Deep Unsupervised Convolutional Network for Multi-focus Image Fusion
    Mustafa, Hafiz Tayyab
    Liu, Fanghui
    Yang, Jie
    Khan, Zubair
    Huang, Qiao
    ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 153 - 163