Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization

被引:2
作者
Oliveira, Guilherme C. [1 ,2 ]
Rosa, Gustavo H. [1 ]
Pedronette, Daniel C. G. [1 ]
Papa, Joao P. [1 ]
Kumar, Himeesh [3 ]
Passos, Leandro A. [1 ]
Kumar, Dinesh [2 ]
机构
[1] Sao Paulo State Univ, Sch Sci, Sao Paulo, Brazil
[2] RMIT Univ, Sch Engn, Melbourne, Vic, Australia
[3] Univ Melbourne, Ctr Eye Res, Melbourne, Vic, Australia
基金
英国工程与自然科学研究理事会; 巴西圣保罗研究基金会;
关键词
Medical images; Age -related macular degeneration; Data augmentation; Deep learning; Generative Adversarial Networks; StyleGAN2; DIABETIC-RETINOPATHY; MACULAR DEGENERATION; GLOBAL PREVALENCE;
D O I
10.1016/j.bspc.2024.106263
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Deep learning applications for assessing medical images are limited because the datasets are often small and imbalanced. The use of synthetic data has been proposed in the literature, but neither a robust comparison of the different methods nor generalizability has been reported. Our approach integrates a retinal image quality assessment model and StyleGAN2 architecture to enhance Age-related Macular Degeneration (AMD) detection capabilities and improve generalizability. This work compares ten different Generative Adversarial Network (GAN) architectures to generate synthetic eye-fundus images with and without AMD. We combined subsets of three public databases (iChallenge-AMD, ODIR-2019, and RIADD) to form a single training and test set. We employed the STARE dataset for external validation, ensuring a comprehensive assessment of the proposed approach. The results show that StyleGAN2 reached the lowest Fr & eacute;chet Inception Distance (166.17), and clinicians could not accurately differentiate between real and synthetic images. ResNet-18 architecture obtained the best performance with 85% accuracy and outperformed the two human experts (80% and 75%) in detecting AMD fundus images. The accuracy rates were 82.8% for the test set and 81.3% for the STARE dataset, demonstrating the model's generalizability. The proposed methodology for synthetic medical image generation has been validated for robustness and accuracy, with free access to its code for further research and development in this field.
引用
收藏
页数:9
相关论文
共 63 条
  • [1] FundusGAN: Fundus image synthesis based on semi-supervised learning
    Ahn, Sangil
    Song, Su Jeong
    Shin, Jitae
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [2] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [3] Generative Adversarial Networks (GANs) for Retinal Fundus Image Synthesis
    Bellemo, Valentina
    Burlina, Philippe
    Yong, Liu
    Wong, Tien Yin
    Ting, Daniel Shu Wei
    [J]. COMPUTER VISION - ACCV 2018 WORKSHOPS, 2019, 11367 : 289 - 302
  • [4] Berthelot D, 2017, Arxiv, DOI arXiv:1703.10717
  • [5] Artificial Intelligence to Stratify Severity of Age-Related Macular Degeneration (AMD) and Predict Risk of Progression to Late AMD
    Bhuiyan, Alauddin
    Wong, Tien Yin
    Ting, Daniel Shu Wei
    Govindaiah, Arun
    Souied, Eric H.
    Smith, R. Theodore
    [J]. TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02):
  • [6] A Close Look at Deep Learning with Small Data
    Brigato, Lorenzo
    Iocchi, Luca
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2490 - 2497
  • [7] Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks
    Brown, James M.
    Campbell, J. Peter
    Beers, Andrew
    Chang, Ken
    Ostmo, Susan
    Chan, R. V. Paul
    Dy, Jennifer
    Erdogmus, Deniz
    Ioannidis, Stratis
    Kalpathy-Cramer, Jayashree
    Chiang, Michael F.
    [J]. JAMA OPHTHALMOLOGY, 2018, 136 (07) : 803 - 810
  • [8] Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration
    Burlina, Philippe M.
    Joshi, Neil
    Pacheco, Katia D.
    Liu, T. Y. Alvin
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2019, 137 (03) : 258 - 264
  • [9] Use of Deep Learning for Detailed Severity Characterization and Estimation of 5-Year Risk Among Patients With Age-Related Macular Degeneration
    Burlina, Philippe M.
    Joshi, Neil
    Pacheco, Katia D.
    Freund, David E.
    Kong, Jun
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2018, 136 (12) : 1359 - 1366
  • [10] Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks
    Burlina, Philippe M.
    Joshi, Neil
    Pekala, Michael
    Pacheco, Katia D.
    Freund, David E.
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2017, 135 (11) : 1170 - 1176