Deep learning-based automated detection for diabetic retinopathy and diabetic macular oedema in retinal fundus photographs

被引:73
作者
Li, Feng [1 ]
Wang, Yuguang [1 ]
Xu, Tianyi [2 ]
Dong, Lin [1 ]
Yan, Lei [1 ]
Jiang, Minshan [1 ]
Zhang, Xuedian [1 ,3 ]
Jiang, Hong [2 ]
Wu, Zhizheng [4 ]
Zou, Haidong [5 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Med, Shanghai Peoples Hosp 9, Dept Anesthesia, Shanghai, Peoples R China
[3] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai, Peoples R China
[4] Shanghai Univ, Dept Precis Mech Engn, Shanghai, Peoples R China
[5] Shanghai First Peoples Hosp, Dept Ophthalmol, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
VALIDATION; DISEASES;
D O I
10.1038/s41433-021-01552-8
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Objectives To present and validate a deep ensemble algorithm to detect diabetic retinopathy (DR) and diabetic macular oedema (DMO) using retinal fundus images. Methods A total of 8739 retinal fundus images were collected from a retrospective cohort of 3285 patients. For detecting DR and DMO, a multiple improved Inception-v4 ensembling approach was developed. We measured the algorithm's performance and made a comparison with that of human experts on our primary dataset, while its generalization was assessed on the publicly available Messidor-2 dataset. Also, we investigated systematically the impact of the size and number of input images used in training on model's performance, respectively. Further, the time budget of training/inference versus model performance was analyzed. Results On our primary test dataset, the model achieved an 0.992 (95% CI, 0.989-0.995) AUC corresponding to 0.925 (95% CI, 0.916-0.936) sensitivity and 0.961 (95% CI, 0.950-0.972) specificity for referable DR, while the sensitivity and specificity for ophthalmologists ranged from 0.845 to 0.936, and from 0.912 to 0.971, respectively. For referable DMO, our model generated an AUC of 0.994 (95% CI, 0.992-0.996) with a 0.930 (95% CI, 0.919-0.941) sensitivity and 0.971 (95% CI, 0.965-0.978) specificity, whereas ophthalmologists obtained sensitivities ranging between 0.852 and 0.946, and specificities ranging between 0.926 and 0.985. Conclusion This study showed that the deep ensemble model exhibited excellent performance in detecting DR and DMO, and had good robustness and generalization, which could potentially help support and expand DR/DMO screening programs.
引用
收藏
页码:1433 / 1441
页数:9
相关论文
共 35 条
[1]   Automatic recognition of severity level for diagnosis of diabetic retinopathy using deep visual features [J].
Abbas, Qaisar ;
Fondon, Irene ;
Sarmiento, Auxiliadora ;
Jimenez, Soledad ;
Alemany, Pedro .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2017, 55 (11) :1959-1974
[2]   DR|GRADUATE: Uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images [J].
Araujo, Teresa ;
Aresta, Guilherme ;
Mendonca, Luis ;
Penas, Susana ;
Maia, Carolina ;
Carneiro, Angela ;
Maria Mendonca, Ana ;
Campilho, Aurelio .
MEDICAL IMAGE ANALYSIS, 2020, 63
[3]   Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study [J].
Bellemo, Valentina ;
Lim, Zhan W. ;
Lim, Gilbert ;
Nguyen, Quang D. ;
Xie, Yuchen ;
Yip, Michelle Y. T. ;
Hamzah, Haslina ;
Ho, Jinyi ;
Lee, Xin Q. ;
Hsu, Wynne ;
Lee, Mong L. ;
Musonda, Lillian ;
Chandran, Manju ;
Chipalo-Mutati, Grace ;
Muma, Mulenga ;
Tan, Gavin S. W. ;
Sivaprasad, Sobha ;
Menon, Geeta ;
Wong, Tien Y. ;
Ting, Daniel S. W. .
LANCET DIGITAL HEALTH, 2019, 1 (01) :E35-E44
[4]   Addressing class imbalance in deep learning for small lesion detection on medical images [J].
Bria, Alessandro ;
Marrocco, Claudio ;
Tortorella, Francesco .
COMPUTERS IN BIOLOGY AND MEDICINE, 2020, 120
[5]   Assessment of Deep Generative Models for High-Resolution Synthetic Retinal Image Generation of Age-Related Macular Degeneration [J].
Burlina, Philippe M. ;
Joshi, Neil ;
Pacheco, Katia D. ;
Liu, T. Y. Alvin ;
Bressler, Neil M. .
JAMA OPHTHALMOLOGY, 2019, 137 (03) :258-264
[6]   A deep learning interpretable classifier for diabetic retinopathy disease grading [J].
de la Torre, Jordi ;
Valls, Aida ;
Puig, Domenec .
NEUROCOMPUTING, 2020, 396 :465-476
[7]   FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE [J].
Decenciere, Etienne ;
Zhang, Xiwei ;
Cazuguel, Guy ;
Lay, Bruno ;
Cochener, Beatrice ;
Trone, Caroline ;
Gain, Philippe ;
Ordonez-Varela, John-Richard ;
Massin, Pascale ;
Erginay, Ali ;
Charton, Beatrice ;
Klein, Jean-Claude .
IMAGE ANALYSIS & STEREOLOGY, 2014, 33 (03) :231-234
[8]   Deep neural networks to predict diabetic retinopathy [J].
Gadekallu, Thippa Reddy ;
Khare, Neelu ;
Bhattacharya, Sweta ;
Singh, Saurabh ;
Maddikunta, Praveen Kumar Reddy ;
Srivastava, Gautam .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 14 (5) :5407-5420
[9]   Automated Identification of Diabetic Retinopathy Using Deep Learning [J].
Gargeya, Rishab ;
Leng, Theodore .
OPHTHALMOLOGY, 2017, 124 (07) :962-969
[10]   Evaluation of a deep learning system for the joint automated detection of diabetic retinopathy and age-related macular degeneration [J].
Gonzalez-Gonzalo, Cristina ;
Sanchez-Gutierrez, Veronica ;
Hernandez-Martinez, Paula ;
Contreras, Ines ;
Lechanteur, Yara T. ;
Domanian, Artin ;
van Ginneken, Bram ;
Sanchez, Clara I. .
ACTA OPHTHALMOLOGICA, 2020, 98 (04) :368-377