Evaluation of Generative Adversarial Networks for High-Resolution Synthetic Image Generation of Circumpapillary Optical Coherence Tomography Images for Glaucoma

被引:24
作者
Sreejith Kumar, Ashish Jith [1 ,3 ,4 ]
Chong, Rachel S. [2 ]
Crowston, Jonathan G. [1 ,2 ]
Chua, Jacqueline [1 ,2 ]
Bujor, Inna [8 ]
Husain, Rahat [1 ,2 ]
Vithana, Eranga N. [1 ,2 ]
Girard, Michael J. A. [1 ,2 ,5 ]
Ting, Daniel S. W. [1 ,2 ]
Cheng, Ching-Yu [1 ,2 ,5 ]
Aung, Tin [1 ,2 ,6 ]
Popa-Cherecheanu, Alina [8 ,9 ]
Schmetterer, Leopold [1 ,2 ,3 ,5 ,7 ,10 ,11 ,12 ]
Wong, Damon [1 ,3 ]
机构
[1] Singapore Natl Eye Ctr, Singapore Eye Res Inst, Singapore, Singapore
[2] Duke NUS Med Sch, Acad Clin Program, Singapore, Singapore
[3] SERI NTU Adv Ocular Engn STANCE, Singapore, Singapore
[4] ASTAR, Inst Infocomm Res, Singapore, Singapore
[5] Inst Mol & Clin Ophthalmol, Basel, Switzerland
[6] Natl Univ Singapore, Yong Loo Lin Sch Med, Dept Ophthalmol, Singapore, Singapore
[7] Med Univ Vienna, Dept Ophthalmol & Optometry, Vienna, Austria
[8] Carol Davila Univ Med & Pharm, Bucharest, Romania
[9] Emergency Univ Hosp, Dept Ophthalmol, Bucharest, Romania
[10] Nanyang Technol Univ, Sch Chem & Biomed Engn, Singapore, Singapore
[11] Med Univ Vienna, Dept Clin Pharmacol, Vienna, Austria
[12] Med Univ Vienna, Ctr Med Phys & Biomed Engn, Vienna, Austria
基金
新加坡国家研究基金会; 英国医学研究理事会;
关键词
NERVE-FIBER LAYER; DIABETIC-RETINOPATHY; GLOBAL PREVALENCE; VALIDATION; THICKNESS; EYE; OCT;
D O I
10.1001/jamaophthalmol.2022.3375
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
IMPORTANCE Deep learning (DL) networks require large data sets for training, which can be challenging to collect clinically. Generative models could be used to generate large numbers of synthetic optical coherence tomography (OCT) images to train such DL networks for glaucoma detection. OBJECTIVE To assess whether generative models can synthesize circumpapillary optic nerve head OCT images of normal and glaucomatous eyes and determine the usability of synthetic images for training DL models for glaucoma detection. DESIGN, SETTING, AND PARTICIPANTS Progressively growing generative adversarial network models were trained to generate circumpapillary OCT scans. Image gradeability and authenticity were evaluated on a clinical set of 100 real and 100 synthetic images by 2 clinical experts. DL networks for glaucoma detection were trained with real or synthetic images and evaluated on independent internal and external test data sets of 140 and 300 real images, respectively. MAIN OUTCOMES AND MEASURES Evaluations of the clinical set between the experts were compared. Glaucoma detection performance of the DL networks was assessed using area under the curve (AUC) analysis. Class activation maps provided visualizations of the regions contributing to the respective classifications. RESULTS A total of 990 normal and 862 glaucomatous eyes were analyzed. Evaluations of the clinical set were similar for gradeability (expert 1: 92.0%; expert 2: 93.0%) and authenticity (expert 1: 51.8%; expert 2: 51.3%). The best-performing DL network trained on synthetic images had AUC scores of 0.97 (95% CI, 0.95-0.99) on the internal test data set and 0.90 (95% CI, 0.87-0.93) on the external test data set, compared with AUCs of 0.96 (95% CI, 0.94-0.99) on the internal test data set and 0.84 (95% CI, 0.80-0.87) on the external test data set for the network trained with real images. An increase in the AUC for the synthetic DL network was observed with the use of larger synthetic data set sizes. Class activation maps showed that the regions of the synthetic images contributing to glaucoma detection were generally similar to that of real images. CONCLUSIONS AND RELEVANCE DL networks trained with synthetic OCT images for glaucoma detection were comparable with networks trained with real images. These results suggest potential use of generative models in the training of DL networks and as a means of data sharing across institutions without patient information confidentiality issues.
引用
收藏
页码:974 / 981
页数:8
相关论文
共 44 条
  • [1] Pix2pix Conditional Generative Adversarial Networks for Scheimpflug Camera Color-Coded Corneal Tomography Image Generation
    Abdelmotaal, Hazem
    Abdou, Ahmed A.
    Omar, Ahmed F.
    El-Sebaity, Dalia Mohamed
    Abdelazeem, Khaled
    [J]. TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2021, 10 (07):
  • [2] World Medical Association Declaration of Helsinki Ethical Principles for Medical Research Involving Human Subjects
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2013, 310 (20): : 2191 - 2194
  • [3] Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study
    Bellemo, Valentina
    Lim, Zhan W.
    Lim, Gilbert
    Nguyen, Quang D.
    Xie, Yuchen
    Yip, Michelle Y. T.
    Hamzah, Haslina
    Ho, Jinyi
    Lee, Xin Q.
    Hsu, Wynne
    Lee, Mong L.
    Musonda, Lillian
    Chandran, Manju
    Chipalo-Mutati, Grace
    Muma, Mulenga
    Tan, Gavin S. W.
    Sivaprasad, Sobha
    Menon, Geeta
    Wong, Tien Y.
    Ting, Daniel S. W.
    [J]. LANCET DIGITAL HEALTH, 2019, 1 (01): : E35 - E44
  • [4] Bowd C, 2000, ARCH OPHTHALMOL-CHIC, V118, P22
  • [5] Prevalence of Glaucoma in an Urban West African Population The Tema Eye Survey
    Budenz, Donald L.
    Barton, Keith
    Whiteside-de Vos, Julia
    Schiffman, Joyce
    Bandi, Jagadeesh
    Nolan, Winifred
    Herndon, Leon
    Kim, Hanna
    Hay-Smith, Graham
    Tielsch, James M.
    [J]. JAMA OPHTHALMOLOGY, 2013, 131 (05) : 651 - 658
  • [6] Low-Shot Deep Learning of Diabetic Retinopathy With Potential Applications to Address Artificial Intelligence Bias in Retinal Diagnostics and Rare Ophthalmic Diseases
    Burlina, Philippe
    Paul, William
    Mathew, Philip
    Joshi, Neil
    Pacheco, Katia D.
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2020, 138 (10) : 1070 - 1077
  • [7] Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration
    Burlina, Philippe M.
    Joshi, Neil
    Pacheco, Katia D.
    Liu, T. Y. Alvin
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2019, 137 (03) : 258 - 264
  • [8] Deepfakes in Ophthalmology Applications and Realism of Synthetic Retinal Images from Generative Adversarial Networks
    Chen, Jimmy S.
    Coyner, Aaron S.
    Chan, R. V. Paul
    Hartnett, M. Elizabeth
    Moshfeghi, Darius M.
    Owen, Leah A.
    Kalpathy-Cramer, Jayashree
    Chiang, Michael F.
    Campbell, J. Peter
    [J]. OPHTHALMOLOGY SCIENCE, 2021, 1 (04):
  • [9] DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images
    Cheong, Haris
    Devalla, Sripad Krishna
    Tan Hung Pham
    Zhang, Liang
    Tin Aung Tun
    Wang, Xiaofei
    Perera, Shamira
    Schmetterer, Leopold
    Tin Aung
    Boote, Craig
    Thiery, Alexandre
    Girard, Michael J. A.
    [J]. TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02): : 1 - 15
  • [10] Diagnostic Ability of Individual Macular Layers by Spectral-Domain OCT in Different Stages of Glaucoma
    Chua, Jacqueline
    Tan, Bingyao
    Ke, Mengyuan
    Schwarzhans, Florian
    Vass, Clemens
    Wong, Damon
    Nongpiur, Monisha E.
    Chua, Mae Chui Wei
    Yao, Xinwen
    Cheng, Ching-Yu
    Aung, Tin
    Schmetterer, Leopold
    [J]. OPHTHALMOLOGY GLAUCOMA, 2020, 3 (05): : 314 - 326