Deep residual transfer learning for automatic diagnosis and grading of diabetic retinopathy

被引:46
作者
Martinez-Murcia, Francisco J. [1 ,3 ]
Ortiz, Andres [1 ,3 ]
Ramirez, Javier [2 ,3 ]
Gorriz, Juan M. [2 ,3 ]
Cruz, Ricardo [1 ]
机构
[1] Univ Malaga, Dept Commun Engn, Malaga, Spain
[2] Univ Granada, Dept Signal Theory Commun & Networking, Granada, Spain
[3] Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
关键词
Deep learning; Residual learning; Transfer learning; Convolutional neural network; Retinography; Diabetic retinopathy; VESSEL SEGMENTATION; CLASSIFICATION; IMAGES;
D O I
10.1016/j.neucom.2020.04.148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evaluation and diagnosis of retina pathology is usually made via the analysis of different image modal-ities that allow to explore its structure. The most popular retina image method is retinography, a tech-nique that displays the fundus of the eye, including the retina and other structures. Retinography is the most common imaging method to diagnose retina diseases such as Diabetic Retinopathy (DB) or Macular Edema (ME). However, retinography evaluation to score the image according to the disease grade presents difficulties due to differences in contrast, brightness and the presence of artifacts. Therefore, it is mainly done via manual analysis; a time consuming task that requires a trained clinician to examine and evaluate the images. In this paper, we present a computer aided diagnosis tool that takes advantage of the performance provided by deep learning architectures for image analysis. Our proposal is based on a deep residual convolutional neural network for extracting discriminatory features with no prior complex image transformations to enhance the image quality or to highlight specific structures. Moreover, we used the transfer learning paradigm to reuse layers from deep neural networks previously trained on the ImageNet dataset, under the hypothesis that first layers capture abstract features than can be reused for different problems. Experiments using different convolutional architectures have been car-ried out and their performance has been evaluated on the MESSIDOR database using cross-validation. Best results were found using a ResNet50-based architecture, showing an AUC of 0.93 for grades 0 + 1, AUC of 0.81 for grade 2 and AUC of 0.92 for grade 3 labelling, as well as AUCs higher than 0.97 when con -sidering a binary classification problem (grades 0 vs 3). (c) 2020 Published by Elsevier B.V.
引用
收藏
页码:424 / 434
页数:11
相关论文
共 46 条
[1]  
A. A. of Ophthalmology. The Eye M.D. Association, 2002, INT CLIN DIAB RET DI
[2]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444
[3]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.90
[4]  
[Anonymous], 2009, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2009.5206848
[5]   Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database [J].
Choi, Joon Yul ;
Yoo, Tae Keun ;
Seo, Jeong Gi ;
Kwak, Jiyong ;
Um, Terry Taewoong ;
Rim, Tyler Hyungtaek .
PLOS ONE, 2017, 12 (11)
[6]   Non-Mydriatic Fundus Retinography in Screening for Diabetic Retinopathy: Agreement Between Family Physicians, General Ophthalmologists, and a Retinal Specialist [J].
Cunha, Leonardo Provetti ;
Figueiredo, Evelyn Alvernaz ;
Araujo, Henrique Pereira ;
Ferreira Costa-Cunha, Luciana Virginia ;
Costa, Carolina Ferreira ;
Costa Neto, Jose de Melo ;
Freitas Matos, Aline Mota ;
de Oliveira, Marise Machado ;
Bastos, Marcus Gomes ;
Ribeiro Monteiro, Mario Luiz .
FRONTIERS IN ENDOCRINOLOGY, 2018, 9
[7]   A deep learning interpretable classifier for diabetic retinopathy disease grading [J].
de la Torre, Jordi ;
Valls, Aida ;
Puig, Domenec .
NEUROCOMPUTING, 2020, 396 :465-476
[8]   FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE [J].
Decenciere, Etienne ;
Zhang, Xiwei ;
Cazuguel, Guy ;
Lay, Bruno ;
Cochener, Beatrice ;
Trone, Caroline ;
Gain, Philippe ;
Ordonez-Varela, John-Richard ;
Massin, Pascale ;
Erginay, Ali ;
Charton, Beatrice ;
Klein, Jean-Claude .
IMAGE ANALYSIS & STEREOLOGY, 2014, 33 (03) :231-234
[9]  
Duin RPW, 2000, INT C PATT RECOG, P1, DOI 10.1109/ICPR.2000.906006
[10]  
Forrest I., 2016, CORR ABS160207360