A Framework for Identifying Diabetic Retinopathy Based on Anti-noise Detection and Attention-Based Fusion

被引:72
作者
Lin, Zhiwen [1 ]
Guo, Ruoqian [1 ]
Wang, Yanjie [1 ]
Wu, Bian [2 ]
Chen, Tingting [1 ]
Wang, Wenzhe [1 ]
Chen, Danny Z. [3 ]
Wu, Jian [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
[2] WeDoctor Grp Ltd, Data Sci & AI Lab, Hangzhou, Zhejiang, Peoples R China
[3] Univ Notre Dame, Dept Comp Sci & Engn, Notre Dame, IN 46556 USA
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT II | 2018年 / 11071卷
关键词
D O I
10.1007/978-3-030-00934-2_9
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Automatic diagnosis of diabetic retinopathy (DR) using retinal fundus images is a challenging problem because images of low grade DR may contain only a few tiny lesions which are difficult to perceive even to human experts. Using annotations in the form of lesion bounding boxes may help solve the problem by deep learning models, but fully annotated samples of this type are usually expensive to obtain. Missing annotated samples (i.e., true lesions but not included in annotations) are noise and can affect learning models negatively. Besides, how to utilize lesion information for identifying DR should be considered carefully because different types of lesions may be used to distinguish different DR grades. In this paper, we propose a new framework for unifying lesion detection and DR identification. Our lesion detection model first determines the missing annotated samples to reduce their impact on the model, and extracts lesion information. Our attention-based network then fuses original images and lesion information to identify DR. Experimental results show that our detection model can considerably reduce the impact of missing annotation and our attention-based network can learn weights between the original images and lesion information for distinguishing different DR grades. Our approach outperforms state-of-the-art methods on two grand challenge retina datasets, EyePACS and Messidor.
引用
收藏
页码:74 / 82
页数:9
相关论文
共 13 条
[1]  
[Anonymous], 2016, Lecture Notes in Computer Science, DOI [10.1007/978-3-319-46493-0_38, DOI 10.1007/978-3-319-46493-0_38]
[2]   Attention to Scale: Scale-aware Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Yang, Yi ;
Wang, Jiang ;
Xu, Wei ;
Yuille, Alan L. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3640-3649
[3]  
DAI L, 2017, LNCS, P525, DOI DOI 10.1007/978-3-319-66179-760
[4]   Automated Identification of Diabetic Retinopathy Using Deep Learning [J].
Gargeya, Rishab ;
Leng, Theodore .
OPHTHALMOLOGY, 2017, 124 (07) :962-969
[5]   Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs [J].
Gulshan, Varun ;
Peng, Lily ;
Coram, Marc ;
Stumpe, Martin C. ;
Wu, Derek ;
Narayanaswamy, Arunachalam ;
Venugopalan, Subhashini ;
Widner, Kasumi ;
Madams, Tom ;
Cuadros, Jorge ;
Kim, Ramasamy ;
Raman, Rajiv ;
Nelson, Philip C. ;
Mega, Jessica L. ;
Webster, R. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22) :2402-2410
[6]  
Kumar Nitin, 2017, Medical Image Computing and Computer Assisted Intervention MICCAI 2017. 20th International Conference. Proceedings: LNCS 10435, P21, DOI 10.1007/978-3-319-66179-7_3
[7]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[8]   Evaluation of a Computer-Aided Diagnosis System for Diabetic Retinopathy Screening on Public Data [J].
Sanchez, Clara I. ;
Niemeijer, Meindert ;
Dumitrescu, Alina V. ;
Suttorp-Schulten, Maria S. A. ;
Abramoff, Michael D. ;
van Ginneken, Bram .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2011, 52 (07) :4866-4871
[9]  
Seoud Lama, 2016, IEEE Trans Med Imaging, V35, P1116, DOI 10.1109/TMI.2015.2509785
[10]   Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images [J].
van Grinsven, Mark J. J. P. ;
van Ginneken, Bram ;
Hoyng, Carel B. ;
Theelen, Thomas ;
Sanchez, Clara I. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (05) :1273-1284