Rotation-Oriented Collaborative Self-Supervised Learning for Retinal Disease Diagnosis

被引:70
作者
Li, Xiaomeng [1 ,2 ]
Hu, Xiaowei [3 ]
Qi, Xiaojuan [4 ]
Yu, Lequan [2 ,5 ]
Zhao, Wei [2 ]
Heng, Pheng-Ann [3 ]
Xing, Lei [2 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
[2] Stanford Univ, Dept Radiat Oncol, Stanford, CA 94305 USA
[3] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[4] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[5] Univ Hong Kong, Dept Stat & Actuarial Sci, Hong Kong, Peoples R China
关键词
Task analysis; Retina; Diseases; Medical diagnosis; Medical diagnostic imaging; Feature extraction; Annotations; Self-supervised learning; retinal disease classification; MACULAR DEGENERATION;
D O I
10.1109/TMI.2021.3075244
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The automatic diagnosis of various conventional ophthalmic diseases from fundus images is important in clinical practice. However, developing such automatic solutions is challenging due to the requirement of a large amount of training data and the expensive annotations for medical images. This paper presents a novel self-supervised learning framework for retinal disease diagnosis to reduce the annotation efforts by learning the visual features from the unlabeled images. To achieve this, we present a rotation-oriented collaborative method that explores rotation-related and rotation-invariant features, which capture discriminative structures from fundus images and also explore the invariant property used for retinal disease classification. We evaluate the proposed method on two public benchmark datasets for retinal disease classification. The experimental results demonstrate that our method outperforms other self-supervised feature learning methods (around 4.2% area under the curve (AUC)). With a large amount of unlabeled data available, our method can surpass the supervised baseline for pathologic myopia (PM) and is very close to the supervised baseline for age-related macular degeneration (AMD), showing the potential benefit of our method in clinical practice.
引用
收藏
页码:2284 / 2294
页数:11
相关论文
共 67 条
[1]   Retinal fundus images for glaucoma analysis: the RIGA dataset [J].
Almazroa, Ahmed ;
Alodhayb, Sami ;
Osman, Essameldin ;
Ramadan, Eslam ;
Hummadi, Mohammed ;
Dlaim, Mohammed ;
Alkatee, Muhannad ;
Raahemifar, Kaamran ;
Lakshminarayanan, Vasudevan .
MEDICAL IMAGING 2018: IMAGING INFORMATICS FOR HEALTHCARE, RESEARCH, AND APPLICATIONS, 2018, 10579
[2]  
Anand R, 2000, OPHTHALMOLOGY, V107, P2224
[3]   Application of deep learning for retinal image analysis: A review [J].
Badar, Maryam ;
Haris, Muhammad ;
Fatima, Anam .
COMPUTER SCIENCE REVIEW, 2020, 35
[4]   Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction [J].
Bai, Wenjia ;
Chen, Chen ;
Tarroni, Giacomo ;
Duan, Jinming ;
Guitton, Florian ;
Petersen, Steffen E. ;
Guo, Yike ;
Matthews, Paul M. ;
Rueckert, Daniel .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :541-549
[5]   How to Learn from Unlabeled Volume Data: Self-supervised 3D Context Feature Learning [J].
Blendowski, Maximilian ;
Nickisch, Hannes ;
Heinrich, Mattias P. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 :649-657
[6]   DETECTION OF AGE-RELATED MACULAR DEGENERATION VIA DEEP LEARNING [J].
Burlina, P. ;
Freund, D. E. ;
Joshi, N. ;
Wolfson, Y. ;
Bressler, N. M. .
2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, :184-188
[7]   Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks [J].
Burlina, Philippe M. ;
Joshi, Neil ;
Pekala, Michael ;
Pacheco, Katia D. ;
Freund, David E. ;
Bressler, Neil M. .
JAMA OPHTHALMOLOGY, 2017, 135 (11) :1170-1176
[8]   Self-supervised learning for medical image analysis using image context restoration [J].
Chen, Liang ;
Bentley, Paul ;
Mori, Kensaku ;
Misawa, Kazunari ;
Fujiwara, Michitaka ;
Rueckert, Daniel .
MEDICAL IMAGE ANALYSIS, 2019, 58
[9]  
Chen T, 2020, PR MACH LEARN RES, V119
[10]  
Chen XY, 2015, IEEE ENG MED BIO, P715, DOI 10.1109/EMBC.2015.7318462