Deep residual transfer learning for automatic diagnosis and grading of diabetic retinopathy

被引:46
作者
Martinez-Murcia, Francisco J. [1 ,3 ]
Ortiz, Andres [1 ,3 ]
Ramirez, Javier [2 ,3 ]
Gorriz, Juan M. [2 ,3 ]
Cruz, Ricardo [1 ]
机构
[1] Univ Malaga, Dept Commun Engn, Malaga, Spain
[2] Univ Granada, Dept Signal Theory Commun & Networking, Granada, Spain
[3] Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
关键词
Deep learning; Residual learning; Transfer learning; Convolutional neural network; Retinography; Diabetic retinopathy; VESSEL SEGMENTATION; CLASSIFICATION; IMAGES;
D O I
10.1016/j.neucom.2020.04.148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evaluation and diagnosis of retina pathology is usually made via the analysis of different image modal-ities that allow to explore its structure. The most popular retina image method is retinography, a tech-nique that displays the fundus of the eye, including the retina and other structures. Retinography is the most common imaging method to diagnose retina diseases such as Diabetic Retinopathy (DB) or Macular Edema (ME). However, retinography evaluation to score the image according to the disease grade presents difficulties due to differences in contrast, brightness and the presence of artifacts. Therefore, it is mainly done via manual analysis; a time consuming task that requires a trained clinician to examine and evaluate the images. In this paper, we present a computer aided diagnosis tool that takes advantage of the performance provided by deep learning architectures for image analysis. Our proposal is based on a deep residual convolutional neural network for extracting discriminatory features with no prior complex image transformations to enhance the image quality or to highlight specific structures. Moreover, we used the transfer learning paradigm to reuse layers from deep neural networks previously trained on the ImageNet dataset, under the hypothesis that first layers capture abstract features than can be reused for different problems. Experiments using different convolutional architectures have been car-ried out and their performance has been evaluated on the MESSIDOR database using cross-validation. Best results were found using a ResNet50-based architecture, showing an AUC of 0.93 for grades 0 + 1, AUC of 0.81 for grade 2 and AUC of 0.92 for grade 3 labelling, as well as AUCs higher than 0.97 when con -sidering a binary classification problem (grades 0 vs 3). (c) 2020 Published by Elsevier B.V.
引用
收藏
页码:424 / 434
页数:11
相关论文
共 46 条
[21]  
Lam Carson, 2018, AMIA Jt Summits Transl Sci Proc, V2017, P147
[22]   Retinal Lesion Detection With Deep Learning Using Image Patches [J].
Lam, Carson ;
Yu, Caroline ;
Huang, Laura ;
Rubin, Daniel .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2018, 59 (01) :590-596
[23]   Deep Convolutional Neural Networks for Diabetic Retinopathy Classification [J].
Lian, Chunyan ;
Liang, Yixiong ;
Kang, Rui ;
Xiang, Yao .
ICAIP 2018: 2018 THE 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN IMAGE PROCESSING, 2018, :68-72
[24]  
Lowe D. G., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1150, DOI 10.1109/ICCV.1999.790410
[25]   Severity analysis of diabetic retinopathy in retinal images using hybrid structure descriptor and modified CNNs [J].
Mahiba, C. ;
Jayachandran, A. .
MEASUREMENT, 2019, 135 :762-767
[26]   Convolutional Neural Networks for Neuroimaging in Parkinson's Disease: Is Preprocessing Needed? [J].
Martinez-Murcia, Francisco J. ;
Gorriz, Juan M. ;
Ramirez, Javier ;
Ortiz, Andres .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2018, 28 (10)
[27]   A Structural Parametrization of the Brain Using Hidden Markov Models-Based Paths in Alzheimer's Disease [J].
Martinez-Murcia, Francisco J. ;
Gorriz, Juan M. ;
Ramirez, Javier ;
Ortiz, Andres .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2016, 26 (07)
[28]   A comparative study of texture measures with classification based on feature distributions [J].
Ojala, T ;
Pietikainen, M ;
Harwood, D .
PATTERN RECOGNITION, 1996, 29 (01) :51-59
[29]   Parkinson's Disease Detection Using Isosurfaces-Based Features and Convolutional Neural Networks [J].
Ortiz, Andres ;
Munilla, Jorge ;
Martinez-Ibanez, Manuel ;
Gorriz, Juan M. ;
Ramirez, Javier ;
Salas-Gonzalez, Diego .
FRONTIERS IN NEUROINFORMATICS, 2019, 13
[30]   Label aided deep ranking for the automatic diagnosis of Parkinsonian syndromes [J].
Ortiz, Andres ;
Martinez Murcia, Francisco J. ;
Munilla, Jorge ;
Gorriz, Juan M. ;
Ramirez, Javier .
NEUROCOMPUTING, 2019, 330 :162-171