A Weakly-Supervised Framework for Interpretable Diabetic Retinopathy Detection on Retinal Images

被引:58
作者
Costa, Pedro [1 ]
Galdran, Adrian [1 ]
Smailagic, Asim [2 ]
Campilho, Aurelio [1 ,3 ]
机构
[1] Inst Syst & Comp Engn Technol & Sci, P-4200465 Porto, Portugal
[2] Carnegie Mellon Univ, Inst Complex Engn Syst, Pittsburgh, PA 15213 USA
[3] Univ Porto, Fac Engn, P-4200464 Porto, Portugal
关键词
Multiple instance learning; diabetic retinopathy detection; bag of visual words; retinal image analysis; COMPUTER-AIDED DIAGNOSIS; AUTOMATIC DETECTION; SCREENING-PROGRAM; CLASSIFICATION; SYSTEM;
D O I
10.1109/ACCESS.2018.2816003
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Diabetic retinopathy (DR) detection is a critical retinal image analysis task in the context of early blindness prevention. Unfortunately, in order to train a model to accurately detect DR based on the presence of different retinal lesions, typically a dataset with medical expert's annotations at the pixel level is needed. In this paper, a new methodology based on the multiple instance learning (MIL) framework is developed in order to overcome this necessity by leveraging the implicit information present on annotations made at the image level. Contrary to previous MIL-based DR detection systems, the main contribution of the proposed technique is the joint optimization of the instance encoding and the image classification stages. In this way, more useful mid-level representations of pathological images can be obtained. The explainability of the model decisions is further enhanced by means of a new loss function enforcing appropriate instance and mid-level representations. The proposed technique achieves comparable or better results than other recently proposed methods, with 90% area under the receiver operating characteristic curve (AUC) on Messidor, 93% AUC on DR1, and 96% AUC on DR2, while improving the interpretability of the produced decisions.
引用
收藏
页码:18747 / 18758
页数:12
相关论文
共 47 条
[1]   Automated Analysis of Retinal Images for Detection of Referable Diabetic Retinopathy [J].
Abramoff, Michael D. ;
Folk, James C. ;
Han, Dennis P. ;
Walker, Jonathan D. ;
Williams, David F. ;
Russell, Stephen R. ;
Massin, Pascale ;
Cochener, Beatrice ;
Gain, Philippe ;
Tang, Li ;
Lamard, Mathieu ;
Moga, Daniela C. ;
Quellec, Gwenole ;
Niemeijer, Meindert .
JAMA OPHTHALMOLOGY, 2013, 131 (03) :351-357
[2]   Multiscale AM-FM Methods for Diabetic Retinopathy Lesion Detection [J].
Agurto, Carla ;
Murray, Victor ;
Barriga, Eduardo ;
Murillo, Sergio ;
Pattichis, Marios ;
Davis, Herbert ;
Russell, Stephen ;
Abramoff, Michael ;
Soliz, Peter .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (02) :502-512
[3]  
Andrews Stuart, 2002, Proceedings of the 15th International Conference on Neural Information Processing Systems. NIPS'02, P561
[4]   An Ensemble-Based System for Microaneurysm Detection and Diabetic Retinopathy Grading [J].
Antal, Balint ;
Hajdu, Andras .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (06) :1720-1726
[5]   AUTOMATIC SYSTEM FOR DIABETIC RETINOPATHY SCREENING BASED ON AM-FM, PARTIAL LEAST SQUARES, AND SUPPORT VECTOR MACHINES [J].
Barriga, E. Simon ;
Murray, Victor ;
Agurto, Carla ;
Pattichis, Marios ;
Bauman, Wendall ;
Zamora, Gilberto ;
Soliz, Peter .
2010 7TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2010, :1349-1352
[6]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[7]   Global estimates of undiagnosed diabetes in adults [J].
Beagley, Jessica ;
Guariguata, Leonor ;
Weil, Clara ;
Motala, Ayesha A. .
DIABETES RESEARCH AND CLINICAL PRACTICE, 2014, 103 (02) :150-160
[8]  
Bergstra J, 2012, J MACH LEARN RES, V13, P281
[9]   MILES: Multiple-Instance Learning via Embedded instance Selection [J].
Chen, Yixin ;
Bi, Jinbo ;
Wang, James Z. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :1931-1947
[10]   Classification of COPD with Multiple Instance Learning [J].
Cheplygina, Veronika ;
Sorensen, Lauge ;
Tax, David M. J. ;
Pedersen, Jesper Holst ;
Loog, Marco ;
de Bruijne, Marleen .
2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, :1508-1513