Artificial Intelligence-Assisted Early Detection of Retinitis Pigmentosa - the Most Common Inherited Retinal Degeneration

被引:21
作者
Chen, Ta-Ching [1 ,2 ]
Lim, Wee Shin [3 ]
Wang, Victoria Y. [4 ]
Ko, Mei-Lan [5 ]
Chiu, Shu-, I [3 ]
Huang, Yu-Shu [1 ]
Lai, Feipei [6 ]
Yang, Chung-May [1 ]
Hu, Fung-Rong [1 ]
Jang, Jyh-Shing Roger [3 ]
Yang, Chang-Hao [1 ]
机构
[1] Natl Taiwan Univ, Coll Med, Dept Ophthalmol, Taipei, Taiwan
[2] Natl Taiwan Univ, Coll Med, Grad Inst Clin Med, Taipei, Taiwan
[3] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, 1,Sec 4,Roosevelt Rd, Taipei, Taiwan
[4] Case Western Reserve Univ, Sch Med, Cleveland, OH USA
[5] Natl Taiwan Univ Hosp, Hsinchu Branch, Dept Ophthalmol, Hsinchu, Taiwan
[6] Natl Taiwan Univ, Dept Elect Engn, Taipei, Taiwan
关键词
Retinitis pigmentosa; Image analysis; Deep learning; Fundus photograph; Artificial intelligence; DEEP; SEGMENTATION;
D O I
10.1007/s10278-021-00479-6
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
The purpose of this study was to detect the presence of retinitis pigmentosa (RP) based on color fundus photographs using a deep learning model. A total of 1670 color fundus photographs from the Taiwan inherited retinal degeneration project and National Taiwan University Hospital were acquired and preprocessed. The fundus photographs were labeled RP or normal and divided into training and validation datasets (n = 1284) and a test dataset (n = 386). Three transfer learning models based on pre-trained Inception V3, Inception Resnet V2, and Xception deep learning architectures, respectively, were developed to classify the presence of RP on fundus images. The model sensitivity, specificity, and area under the receiver operating characteristic (AUROC) curve were compared. The results from the best transfer learning model were compared with the reading results of two general ophthalmologists, one retinal specialist, and one specialist in retina and inherited retinal degenerations. A total of 935 RP and 324 normal images were used to train the models. The test dataset consisted of 193 RP and 193 normal images. Among the three transfer learning models evaluated, the Xception model had the best performance, achieving an AUROC of 96.74%. Gradient-weighted class activation mapping indicated that the contrast between the periphery and the macula on fundus photographs was an important feature in detecting RP. False-positive results were mostly obtained in cases of high myopia with highly tessellated retina, and false-negative results were mostly obtained in cases of unclear media, such as cataract, that led to a decrease in the contrast between the peripheral retina and the macula. Our model demonstrated the highest accuracy of 96.00%, which was comparable with the average results of 81.50%, of the other four ophthalmologists. Moreover, the accuracy was obtained at the same level of sensitivity (95.71%), as compared to an inherited retinal disease specialist. RP is an important disease, but its early and precise diagnosis is challenging. We developed and evaluated a transfer-learning-based model to detect RP from color fundus photographs. The results of this study validate the utility of deep learning in automating the identification of RP from fundus photographs.
引用
收藏
页码:948 / 958
页数:11
相关论文
共 18 条
  • [1] Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks
    Burlina, Philippe M.
    Joshi, Neil
    Pekala, Michael
    Pacheco, Katia D.
    Freund, David E.
    Bressler, Neil M.
    [J]. JAMA OPHTHALMOLOGY, 2017, 135 (11) : 1170 - 1176
  • [2] Deep learning for the segmentation of preserved photoreceptors on en face optical coherence tomography in two inherited retinal diseases
    Camino, Acner
    Wang, Zhuo
    Wang, Jie
    Pennesi, Mark E.
    Yang, Paul
    Huang, David
    Li, Dengwang
    Jia, Yali
    [J]. BIOMEDICAL OPTICS EXPRESS, 2018, 9 (07): : 3092 - 3105
  • [3] Xception: Deep Learning with Depthwise Separable Convolutions
    Chollet, Francois
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1800 - 1807
  • [4] Performance of Deep Learning Architectures and Transfer Learning for Detecting Glaucomatous Optic Neuropathy in Fundus Photographs
    Christopher, Mark
    Beighith, Akram
    Bowd, Christopher
    Proudfoot, James A.
    Goldbaum, Michael H.
    Weinreb, Robert N.
    Girkin, Christopher A.
    Liebmann, Jeffrey M.
    Zangwill, Linda M.
    [J]. SCIENTIFIC REPORTS, 2018, 8
  • [5] Prediction of Causative Genes in Inherited Retinal Disorders from Spectral-Domain Optical Coherence Tomography Utilizing Deep Learning Techniques
    Fujinami-Yokokawa, Yu
    Pontikos, Nikolas
    Yang, Lizhu
    Tsunoda, Kazushige
    Yoshitake, Kazutoshi
    Iwata, Takeshi
    Miyata, Hiroaki
    Fujinami, Kaoru
    [J]. JOURNAL OF OPHTHALMOLOGY, 2019, 2019
  • [6] Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs
    Gulshan, Varun
    Peng, Lily
    Coram, Marc
    Stumpe, Martin C.
    Wu, Derek
    Narayanaswamy, Arunachalam
    Venugopalan, Subhashini
    Widner, Kasumi
    Madams, Tom
    Cuadros, Jorge
    Kim, Ramasamy
    Raman, Rajiv
    Nelson, Philip C.
    Mega, Jessica L.
    Webster, R.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22): : 2402 - 2410
  • [7] Retinitis pigmentosa
    Hartong, Dyonne T.
    Berson, Eliot L.
    Dryja, Thaddeus P.
    [J]. LANCET, 2006, 368 (9549) : 1795 - 1809
  • [8] Telemedicine screening of retinal diseases with a handheld portable non-mydriatic fundus camera
    Jin, Kai
    Lu, Haitong
    Su, Zhaoan
    Cheng, Chuming
    Ye, Juan
    Qian, Dahong
    [J]. BMC OPHTHALMOLOGY, 2017, 17
  • [9] Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
    Kermany, Daniel S.
    Goldbaum, Michael
    Cai, Wenjia
    Valentim, Carolina C. S.
    Liang, Huiying
    Baxter, Sally L.
    McKeown, Alex
    Yang, Ge
    Wu, Xiaokang
    Yan, Fangbing
    Dong, Justin
    Prasadha, Made K.
    Pei, Jacqueline
    Ting, Magdalena
    Zhu, Jie
    Li, Christina
    Hewett, Sierra
    Dong, Jason
    Ziyar, Ian
    Shi, Alexander
    Zhang, Runze
    Zheng, Lianghong
    Hou, Rui
    Shi, William
    Fu, Xin
    Duan, Yaou
    Huu, Viet A. N.
    Wen, Cindy
    Zhang, Edward D.
    Zhang, Charlotte L.
    Li, Oulan
    Wang, Xiaobo
    Singer, Michael A.
    Sun, Xiaodong
    Xu, Jie
    Tafreshi, Ali
    Lewis, M. Anthony
    Xia, Huimin
    Zhang, Kang
    [J]. CELL, 2018, 172 (05) : 1122 - +
  • [10] Deep-learning based, automated segmentation of macular edema in optical coherence tomography
    Lee, Cecilia S.
    Tyring, Ariel J.
    Deruyter, Nicolaas P.
    Wu, Yue
    Rokem, Ariel
    Lee, Aaron Y.
    [J]. BIOMEDICAL OPTICS EXPRESS, 2017, 8 (07): : 3440 - 3448