Deep residual transfer learning for automatic diagnosis and grading of diabetic retinopathy

被引:46
作者
Martinez-Murcia, Francisco J. [1 ,3 ]
Ortiz, Andres [1 ,3 ]
Ramirez, Javier [2 ,3 ]
Gorriz, Juan M. [2 ,3 ]
Cruz, Ricardo [1 ]
机构
[1] Univ Malaga, Dept Commun Engn, Malaga, Spain
[2] Univ Granada, Dept Signal Theory Commun & Networking, Granada, Spain
[3] Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
关键词
Deep learning; Residual learning; Transfer learning; Convolutional neural network; Retinography; Diabetic retinopathy; VESSEL SEGMENTATION; CLASSIFICATION; IMAGES;
D O I
10.1016/j.neucom.2020.04.148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evaluation and diagnosis of retina pathology is usually made via the analysis of different image modal-ities that allow to explore its structure. The most popular retina image method is retinography, a tech-nique that displays the fundus of the eye, including the retina and other structures. Retinography is the most common imaging method to diagnose retina diseases such as Diabetic Retinopathy (DB) or Macular Edema (ME). However, retinography evaluation to score the image according to the disease grade presents difficulties due to differences in contrast, brightness and the presence of artifacts. Therefore, it is mainly done via manual analysis; a time consuming task that requires a trained clinician to examine and evaluate the images. In this paper, we present a computer aided diagnosis tool that takes advantage of the performance provided by deep learning architectures for image analysis. Our proposal is based on a deep residual convolutional neural network for extracting discriminatory features with no prior complex image transformations to enhance the image quality or to highlight specific structures. Moreover, we used the transfer learning paradigm to reuse layers from deep neural networks previously trained on the ImageNet dataset, under the hypothesis that first layers capture abstract features than can be reused for different problems. Experiments using different convolutional architectures have been car-ried out and their performance has been evaluated on the MESSIDOR database using cross-validation. Best results were found using a ResNet50-based architecture, showing an AUC of 0.93 for grades 0 + 1, AUC of 0.81 for grade 2 and AUC of 0.92 for grade 3 labelling, as well as AUCs higher than 0.97 when con -sidering a binary classification problem (grades 0 vs 3). (c) 2020 Published by Elsevier B.V.
引用
收藏
页码:424 / 434
页数:11
相关论文
共 46 条
[11]   An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation [J].
Fraz, Muhammad Moazam ;
Remagnino, Paolo ;
Hoppe, Andreas ;
Uyyanonvara, Bunyarit ;
Rudnicka, Alicja R. ;
Owen, Christopher G. ;
Barman, Sarah A. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (09) :2538-2548
[12]   Oscillation-Driven Spike-Timing Dependent Plasticity Allows Multiple Overlapping Pattern Recognition in Inhibitory Interneuron Networks [J].
Garrido, Jesus A. ;
Luque, Niceto R. ;
Tolu, Silvia ;
D'Angelo, Egidio .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2016, 26 (05)
[13]   6 Deep Learning in Drug Discovery [J].
Gawehn, Erik ;
Hiss, Jan A. ;
Schneider, Gisbert .
MOLECULAR INFORMATICS, 2016, 35 (01) :3-14
[14]   Joint segmentation and classification of retinal arteries/veins from fundus images [J].
Girard, Fantin ;
Kavalec, Conrad ;
Cheriet, Farida .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2019, 94 :96-109
[15]   Identity Mappings in Deep Residual Networks [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :630-645
[16]  
Initiative A.D.N., 2014, PLOS ONE, V9
[17]  
Jabid Taskeed, 2010, Proceedings 7th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS 2010), P482, DOI 10.1109/AVSS.2010.17
[18]  
Kim K., 2005, INT J NEURAL SYST, V14, P407
[19]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[20]  
Lam C, 2018, AMIA JOINT SUMM TRAN