A Multitask Deep-Learning System to Classify Diabetic Macular Edema for Different Optical Coherence Tomography Devices: A Multicenter Analysis

被引:35
作者
Tang, Fangyao [1 ]
Wang, Xi [2 ]
Ran, An-Ran [1 ]
Chan, Carmen K. M. [3 ]
Ho, Mary [4 ,5 ]
Yip, Wilson [4 ,5 ]
Young, Alvin L. [4 ,5 ]
Lok, Jerry [3 ]
Szeto, Simon [3 ]
Chan, Jason [3 ]
Yip, Fanny [3 ]
Wong, Raymond [3 ]
Tang, Ziqi [1 ]
Yang, Dawei [1 ]
Ng, Danny S. [1 ,3 ]
Chen, Li Jia [1 ,4 ]
Brelen, Marten [1 ]
Chu, Victor [6 ]
Li, Kenneth [6 ]
Lai, Tracy H. T. [6 ]
Tan, Gavin S. [7 ]
Ting, Daniel S. W. [7 ]
Huang, Haifan [8 ,9 ]
Chen, Haoyu [8 ,9 ]
Ma, Jacey Hongjie [10 ]
Tang, Shibo [10 ]
Leng, Theodore [11 ]
Kakavand, Schahrouz [11 ]
Mannil, Suria S. [11 ]
Chang, Robert T. [11 ]
Liew, Gerald [12 ]
Gopinath, Bamini [12 ,13 ]
Lai, Timothy Y. Y. [1 ]
Pang, Chi Pui [1 ]
Scanlon, Peter H. [14 ]
Wong, Tien Yin [7 ]
Tham, Clement C. [1 ,3 ,4 ]
Chen, Hao [15 ]
Heng, Pheng-Ann [2 ]
Cheung, Carol Y. [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Ophthalmol & Visual Sci, Hong Kong, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] Hong Kong Eye Hosp, Hong Kong, Peoples R China
[4] Prince Wales Hosp, Dept Ophthalmol & Visual Sci, Hong Kong, Peoples R China
[5] Alice Ho Miu Ling Nethersole Hosp, Hong Kong, Peoples R China
[6] United Christian Hosp, Hong Kong, Peoples R China
[7] Singapore Natl Eye Ctr, Singapore Eye Res Inst, Singapore, Singapore
[8] Shantou Univ, Joint Shantou Int Eye Ctr, Shantou, Guangdong, Peoples R China
[9] Chinese Univ Hong Kong, Shantou, Guangdong, Peoples R China
[10] Cent South Univ, Aier Sch Ophthalmol, Changsha, Hunan, Peoples R China
[11] Stanford Univ, Byers Eye Inst Stanford, Sch Med, Palo Alto, CA 94304 USA
[12] Univ Sydney, Westmead Inst Med Res, Dept Ophthalmol, Sydney, NSW, Australia
[13] Macquarie Univ, Macquarie Univ Hearing, Dept Linguist, Sydney, NSW, Australia
[14] Gloucestershire Hosp NHS Fdn Trust, Gloucestershire Retinal Res Grp, Gloucester, England
[15] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China
关键词
RETINAL THICKNESS MEASUREMENTS; SCREENING-PROGRAM; RETINOPATHY; REPRODUCIBILITY; SEGMENTATION; RANIBIZUMAB; FLUID;
D O I
10.2337/dc20-3064
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
OBJECTIVE Diabetic macular edema (DME) is the primary cause of vision loss among individuals with diabetes mellitus (DM). We developed, validated, and tested a deep learning (DL) system for classifying DME using images from three common commercially available optical coherence tomography (OCT) devices. RESEARCH DESIGN AND METHODS We trained and validated two versions of a multitask convolution neural network (CNN) to classify DME (center-involved DME [CI-DME], non-CI-DME, or absence of DME) using three-dimensional (3D) volume scans and 2D B-scans, respectively. For both 3D and 2D CNNs, we used the residual network (ResNet) as the backbone. For the 3D CNN, we used a 3D version of ResNet-34 with the last fully connected layer removed as the feature extraction module. A total of 73,746 OCT images were used for training and primary validation. External testing was performed using 26,981 images across seven independent data sets from Singapore, Hong Kong, the U.S., China, and Australia. RESULTS In classifying the presence or absence of DME, the DL system achieved area under the receiver operating characteristic curves (AUROCs) of 0.937 (95% CI 0.920-0.954), 0.958 (0.930-0.977), and 0.965 (0.948-0.977) for the primary data set obtained from CIRRUS, SPECTRALIS, and Triton OCTs, respectively, in addition to AUROCs >0.906 for the external data sets. For further classification of the CI-DME and non-CI-DME subgroups, the AUROCs were 0.968 (0.940-0.995), 0.951 (0.898-0.982), and 0.975 (0.947-0.991) for the primary data set and >0.894 for the external data sets. CONCLUSIONS We demonstrated excellent performance with a DL system for the automated classification of DME, highlighting its potential as a promising second-line screening tool for patients with DM, which may potentially create a more effective triaging mechanism to eye clinics.
引用
收藏
页码:2078 / 2088
页数:11
相关论文
共 36 条
[1]   Reproducibility of Spectral-Domain Optical Coherence Tomography Retinal Thickness Measurements and Conversion to Equivalent Time-Domain Metrics in Diabetic Macular Edema [J].
Bressler, Susan B. ;
Edwards, Allison R. ;
Chalam, Kakarla V. ;
Bressler, Neil M. ;
Glassman, Adam R. ;
Jaffe, Glenn J. ;
Melia, Michele ;
Saggau, David D. ;
Plous, Oren Z. .
JAMA OPHTHALMOLOGY, 2014, 132 (09) :1113-1122
[2]  
Burnett S, 1998, DIABETIC MED, V15, pS38, DOI 10.1002/(SICI)1096-9136(1998110)15:3+<S38::AID-DIA729>3.3.CO
[3]  
2-K
[4]   The Association between Foveal Morphology and Macular Pigment Spatial Distribution: An Ethnicity Study [J].
Ctori, Irene ;
Huntjens, Byki .
PLOS ONE, 2017, 12 (01)
[5]   Clinically applicable deep learning for diagnosis and referral in retinal disease [J].
De Fauw, Jeffrey ;
Ledsam, Joseph R. ;
Romera-Paredes, Bernardino ;
Nikolov, Stanislav ;
Tomasev, Nenad ;
Blackwell, Sam ;
Askham, Harry ;
Glorot, Xavier ;
O'Donoghue, Brendan ;
Visentin, Daniel ;
van den Driessche, George ;
Lakshminarayanan, Balaji ;
Meyer, Clemens ;
Mackinder, Faith ;
Bouton, Simon ;
Ayoub, Kareem ;
Chopra, Reena ;
King, Dominic ;
Karthikesalingam, Alan ;
Hughes, Cian O. ;
Raine, Rosalind ;
Hughes, Julian ;
Sim, Dawn A. ;
Egan, Catherine ;
Tufail, Adnan ;
Montgomery, Hugh ;
Hassabis, Demis ;
Rees, Geraint ;
Back, Trevor ;
Khaw, Peng T. ;
Suleyman, Mustafa ;
Cornebise, Julien ;
Keane, Pearse A. ;
Ronneberger, Olaf .
NATURE MEDICINE, 2018, 24 (09) :1342-+
[6]   Preservation of sight in diabetes: developing a national risk reduction programme [J].
Garvican, L ;
Clowes, J ;
Gillow, T .
DIABETIC MEDICINE, 2000, 17 (09) :627-634
[7]   Reproducibility of Retinal Thickness Measurements on Normal and Pathologic Eyes by Different Optical Coherence Tomography Instruments [J].
Giani, Andrea ;
Cigada, Mario ;
Choudhry, Netan ;
Deiro, Antonio Peroglio ;
Oldani, Marta ;
Pellegrini, Marco ;
Invernizzi, Alessandro ;
Duca, Piergiorgio ;
Miller, Joan W. ;
Staurenghi, Giovanni .
AMERICAN JOURNAL OF OPHTHALMOLOGY, 2010, 150 (06) :815-824
[8]  
Goh James Kang Hao, 2016, J Diabetes Sci Technol, V10, P282, DOI 10.1177/1932296816629491
[9]   Compliance with the quality standards of National Diabetic Retinopathy Screening Committee [J].
Jyothi, Sreedhar ;
Elahi, Babar ;
Srivastava, Anamika ;
Poole, Marilyn ;
Nagi, Dinesh ;
Sivaprasad, Sobha .
PRIMARY CARE DIABETES, 2009, 3 (02) :67-72
[10]   Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning [J].
Kermany, Daniel S. ;
Goldbaum, Michael ;
Cai, Wenjia ;
Valentim, Carolina C. S. ;
Liang, Huiying ;
Baxter, Sally L. ;
McKeown, Alex ;
Yang, Ge ;
Wu, Xiaokang ;
Yan, Fangbing ;
Dong, Justin ;
Prasadha, Made K. ;
Pei, Jacqueline ;
Ting, Magdalena ;
Zhu, Jie ;
Li, Christina ;
Hewett, Sierra ;
Dong, Jason ;
Ziyar, Ian ;
Shi, Alexander ;
Zhang, Runze ;
Zheng, Lianghong ;
Hou, Rui ;
Shi, William ;
Fu, Xin ;
Duan, Yaou ;
Huu, Viet A. N. ;
Wen, Cindy ;
Zhang, Edward D. ;
Zhang, Charlotte L. ;
Li, Oulan ;
Wang, Xiaobo ;
Singer, Michael A. ;
Sun, Xiaodong ;
Xu, Jie ;
Tafreshi, Ali ;
Lewis, M. Anthony ;
Xia, Huimin ;
Zhang, Kang .
CELL, 2018, 172 (05) :1122-+