Artificial Intelligence for Screening of Multiple Retinal and Optic Nerve Diseases

被引:98
作者
Dong, Li [1 ]
He, Wanji [2 ]
Zhang, Ruiheng [1 ]
Ge, Zongyuan [3 ,4 ]
Wang, Ya Xing [5 ]
Zhou, Jinqiong [1 ]
Xu, Jie [5 ]
Shao, Lei [1 ]
Wang, Qian [1 ]
Yan, Yanni [1 ]
Xie, Ying [1 ,6 ]
Fang, Lijian [1 ,7 ]
Wang, Haiwei [1 ,8 ]
Wang, Yenan [1 ,9 ]
Zhu, Xiaobo [1 ,10 ]
Wang, Jinyuan [1 ]
Zhang, Chuan [1 ]
Wang, Heng [1 ]
Wang, Yining [1 ]
Chen, Rongtian [1 ]
Wan, Qianqian [11 ]
Yang, Jingyan [1 ]
Zhou, Wenda [1 ]
Li, Heyan [1 ]
Yao, Xuan [2 ]
Yang, Zhiwen [2 ]
Xiong, Jianhao [2 ]
Wang, Xin [2 ]
Huang, Yelin [2 ]
Chen, Yuzhong [2 ]
Wang, Zhaohui [12 ]
Rong, Ce [12 ]
Gao, Jianxiong [12 ]
Zhang, Huiliang [12 ]
Wu, Shouling [13 ]
Jonas, Jost B. [14 ,15 ]
Wei, Wen Bin [1 ]
机构
[1] Capital Med Univ, Beijing Tongren Hosp,Med Artificial Intelligence, Minist Ind & Informat Technol,Beijing Tongren Eye, Beijing Key Lab Intraocular Tumor Diag & Treatmen, Beijing, Peoples R China
[2] Beijing Airdoc Technol Co Ltd, Beijing, Peoples R China
[3] Monash Univ, eRes Ctr, Melbourne, Vic, Australia
[4] Monash Univ, Fac Engn, ECSE, Melbourne, Vic, Australia
[5] Capital Med Univ, Beijing Tongren Hosp, Beijing Tongren Eye Ctr, Beijing Inst Ophthalmol,Beijing Ophthalmol & Visu, Beijing, Peoples R China
[6] Shanxi Prov Peoples Hosp, Dept Ophthalmol, Taiyuan, Peoples R China
[7] Capital Med Univ, Beijing Liangxiang Hosp, Dept Ophthalmol, Beijing, Peoples R China
[8] Capital Med Univ, Fuxing Hosp, Dept Ophthalmol, Beijing, Peoples R China
[9] Capital Med Univ, Xuanwu Hosp, Dept Ophthalmol, Beijing, Peoples R China
[10] Beijing Univ Chinese Med, Dongfang Hosp, Dept Ophthalmol, Beijing, Peoples R China
[11] Anhui Med Univ, Dept Ophthalmol, Affiliated Hosp 2, Hefei, Peoples R China
[12] iKang Guobin Healthcare Grp Co Ltd, Beijing, Peoples R China
[13] Kailuan Gen Hosp, Dept Cardiol, Tangshan, Hebei, Peoples R China
[14] Heidelberg Univ, Med Fac Mannheim, Dept Ophthalmol, Mannheim, Germany
[15] Inst Mol & Clin Ophthalmol Basel, Basel, Switzerland
关键词
DIABETIC-RETINOPATHY; VALIDATION; SYSTEM;
D O I
10.1001/jamanetworkopen.2022.9960
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
IMPORTANCE The lack of experienced ophthalmologists limits the early diagnosis of retinal diseases. Artificial intelligence can be an efficient real-time way for screening retinal diseases. OBJECTIVE To develop and prospectively validate a deep learning (DL) algorithm that, based on ocular fundus images, recognizes numerous retinal diseases simultaneously in clinical practice. DESIGN, SETTING, AND PARTICIPANTS This multicenter, diagnostic study at 65 public medical screening centers and hospitals in 19 Chinese provinces included individuals attending annual routine medical examinations and participants of population-based and community-based studies. EXPOSURES Based on 120 002 ocular fundus photographs, the Retinal Artificial Intelligence Diagnosis System (RAIDS) was developed to identify 10 retinal diseases. RAIDS was validated in a prospective collected data set, and the performance between RAIDS and ophthalmologists was compared in the data sets of the population-based Beijing Eye Study and the community-based Kailuan Eye Study. MAIN OUTCOMES AND MEASURES The performance of each classifier included sensitivity, specificity, accuracy, Fl score, and Cohen K score. RESULTS In the prospective validation data set of 208 758 images collected from 110 784 individuals (median [range] age, 42 [8-87] years; 115 443 [55.3%] female), RAIDS achieved a sensitivity of 89.8% (95% CI, 89.5%-90.1%) to detect any of 10 retinal diseases. RAIDS differentiated 10 retinal diseases with accuracies ranging from 95.3% to 99.9%, without marked differences between medical screening centers and geographical regions in China. Compared with retinal specialists, RAIDS achieved a higher sensitivity for detection of any retinal abnormality (RAIDS, 91.7% [95% CI, 90.6%-92.8%]; certified ophthalmologists. 83.7% [95% CI, 82.1%-85.1%]; junior retinal specialists, 86.4% [95% CI, 84.9%-87.7%]; and senior retinal specialists, 88.5% [95% CI, 87.1%-89.8%]). RAIDS reached a superior or similar diagnostic sensitivity compared with senior retinal specialists in the detection of 7 of 10 retinal diseases (ie, referral diabetic retinopathy, referral possible glaucoma, macular hole, epiretinal macular membrane, hypertensive retinopathy, myelinated fibers, and retinitis pigmentosa). It achieved a performance comparable with the performance by certified ophthalmologists in 2 diseases (ie, age-related macular degeneration and retinal vein occlusion). Compared with ophthalmologists, RAIDS needed 96% to 97% less time for the image assessment. CONCLUSIONS AND RELEVANCE In this diagnostic study, the DL system was associated with accurately distinguishing10 retinal diseases in real time. This technology may help overcome the lack of experienced ophthalmologists in underdeveloped areas.
引用
收藏
页数:12
相关论文
共 34 条
[1]   Glaucoma risk index: Automated glaucoma detection from color fundus images [J].
Bock, Ruediger ;
Meier, Joerg ;
Nyul, Laszlo G. ;
Hornegger, Joachim ;
Michelson, Georg .
MEDICAL IMAGE ANALYSIS, 2010, 14 (03) :471-481
[2]   Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks [J].
Brown, James M. ;
Campbell, J. Peter ;
Beers, Andrew ;
Chang, Ken ;
Ostmo, Susan ;
Chan, R. V. Paul ;
Dy, Jennifer ;
Erdogmus, Deniz ;
Ioannidis, Stratis ;
Kalpathy-Cramer, Jayashree ;
Chiang, Michael F. .
JAMA OPHTHALMOLOGY, 2018, 136 (07) :803-810
[3]   Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database [J].
Choi, Joon Yul ;
Yoo, Tae Keun ;
Seo, Jeong Gi ;
Kwak, Jiyong ;
Um, Terry Taewoong ;
Rim, Tyler Hyungtaek .
PLOS ONE, 2017, 12 (11)
[4]   A Deep Learning Algorithm for Prediction of Age-Related Eye Disease Study Severity Scale for Age-Related Macular Degeneration from Color Fundus Photography [J].
Grassmann, Felix ;
Mengelkamp, Judith ;
Brandl, Caroline ;
Harsch, Sebastian ;
Zimmermann, Martina E. ;
Linkohr, Birgit ;
Peters, Annette ;
Heid, Iris M. ;
Palm, Christoph ;
Weber, Bernhard H. F. .
OPHTHALMOLOGY, 2018, 125 (09) :1410-1420
[5]   Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs [J].
Gulshan, Varun ;
Peng, Lily ;
Coram, Marc ;
Stumpe, Martin C. ;
Wu, Derek ;
Narayanaswamy, Arunachalam ;
Venugopalan, Subhashini ;
Widner, Kasumi ;
Madams, Tom ;
Cuadros, Jorge ;
Kim, Ramasamy ;
Raman, Rajiv ;
Nelson, Philip C. ;
Mega, Jessica L. ;
Webster, R. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22) :2402-2410
[6]   Multi-label ocular disease classification with a dense correlation deep neural network [J].
He, Junjun ;
Li, Cheng ;
Ye, Jin ;
Qiao, Yu ;
Gu, Lixu .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63
[7]   Accurate prediction of glaucoma from colour fundus images with a convolutional neural network that relies on active and transfer learning [J].
Hemelings, Ruben ;
Elen, Bart ;
Barbosa-Breda, Joao ;
Lemmens, Sophie ;
Meire, Maarten ;
Pourjavan, Sayeh ;
Vandewalle, Evelien ;
Van de Veire, Sara ;
Blaschko, Matthew B. ;
De Boever, Patrick ;
Stalmans, Ingeborg .
ACTA OPHTHALMOLOGICA, 2020, 98 (01) :E94-E100
[8]   Ophthalmologist-Level Classification of Fundus Disease With Deep Neural Networks [J].
Jiang, Ping ;
Dou, Quansheng ;
Shi, Li .
TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02) :1-9
[9]   Is it time to consider glaucoma screening cost-effective? [J].
Kanclerz, Piotr ;
Grzybowski, Andrzej ;
Tuuminen, Raimo .
LANCET GLOBAL HEALTH, 2019, 7 (11) :E1490-E1490
[10]   A Deep Learning Approach for Automated Detection of Geographic Atrophy from Color Fundus Photographs [J].
Keenan, Tiarnan D. ;
Dharssi, Shazia ;
Peng, Yifan ;
Chen, Qingyu ;
Agron, Elvira ;
Wong, Wai T. ;
Lu, Zhiyong ;
Chew, Emily Y. .
OPHTHALMOLOGY, 2019, 126 (11) :1533-1540