Intra- and Inter-Slice Contrastive Learning for Point Supervised OCT Fluid Segmentation

被引:39
作者
He, Xingxin [1 ]
Fang, Leyuan [1 ]
Tan, Mingkui [2 ]
Chen, Xiangdong [3 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] South China Univ Technol, Sch Software Engn, Guangzhou 510006, Peoples R China
[3] Hunan Univ Chinese Med, Affiliated Hosp 1, Dept Ophthalmol, Changsha 410082, Peoples R China
基金
中国国家自然科学基金;
关键词
Fluids; Image segmentation; Retina; Annotations; Task analysis; Proposals; Convolutional neural networks; Optical coherence tomography; fluid segmentation; convolutional neural network; weakly-supervised learning; contrastive learning; MACULAR EDEMA; CONVOLUTIONAL NETWORKS; AUTOMATED SEGMENTATION; RETINAL LAYER; DEFINITION; FRAMEWORK; PATHOLOGY;
D O I
10.1109/TIP.2022.3148814
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
OCT fluid segmentation is a crucial task for diagnosis and therapy in ophthalmology. The current convolutional neural networks (CNNs) supervised by pixel-wise annotated masks achieve great success in OCT fluid segmentation. However, requiring pixel-wise masks from OCT images is time-consuming, expensive and expertise needed. This paper proposes an Intra- and inter-Slice Contrastive Learning Network (ISCLNet) for OCT fluid segmentation with only point supervision. Our ISCLNet learns visual representation by designing contrastive tasks that exploit the inherent similarity or dissimilarity from unlabeled OCT data. Specifically, we propose an intra-slice contrastive learning strategy to leverage the fluid-background similarity and the retinal layer-background dissimilarity. Moreover, we construct an inter-slice contrastive learning architecture to learn the similarity of adjacent OCT slices from one OCT volume. Finally, an end-to-end model combining intra- and inter-slice contrastive learning processes learns to segment fluid under the point supervision. The experimental results on two public OCT fluid segmentation datasets (i.e., AI Challenger and RETOUCH) demonstrate that the ISCLNet bridges the gap between fully-supervised and weakly-supervised OCT fluid segmentation and outperforms other well-known point-supervised segmentation methods.
引用
收藏
页码:1870 / 1881
页数:12
相关论文
共 71 条
[61]   Label propagation and higher-order constraint-based segmentation of fluid-associated regions in retinal SD-OCT images [J].
Wang, Tao ;
Ji, Zexuan ;
Sun, Quansen ;
Chen, Qiang ;
Yu, Shengchen ;
Fan, Wen ;
Yuan, Songtao ;
Liu, Qinghuai .
INFORMATION SCIENCES, 2016, 358 :92-111
[62]  
Wang Y., 2019, ARXIV190903714
[63]   Automated Segmentation of Intraretinal Cystoid Fluid in Optical Coherence Tomography [J].
Wilkins, Gary R. ;
Houghton, Odette M. ;
Oldenburg, Amy L. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (04) :1109-1114
[64]   Spectral-Domain Optical Coherence Tomography Use in Macular Diseases: A Review [J].
Wolf, Sebastian ;
Wolf-Schnurrbusch, Ute .
OPHTHALMOLOGICA, 2010, 224 (06) :333-340
[65]  
Xing Tao, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12264), P238, DOI 10.1007/978-3-030-59719-1_24
[66]   Dual-stage deep learning framework for pigment epithelium detachment segmentation in polypoidal choroidal vasculopathy [J].
Xu, Yupeng ;
Yan, Ke ;
Kim, Jinman ;
Wang, Xiuying ;
Li, Changyang ;
Su, Li ;
Yu, Suqin ;
Xu, Xun ;
Feng, Dagan David .
BIOMEDICAL OPTICS EXPRESS, 2017, 8 (09) :4061-4076
[67]  
Zhang Y., 2020, Contrastive learning of medical visual representations from paired images and text
[68]   Learning Deep Features for Discriminative Localization [J].
Zhou, Bolei ;
Khosla, Aditya ;
Lapedriza, Agata ;
Oliva, Aude ;
Torralba, Antonio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2921-2929
[69]   UNet plus plus : A Nested U-Net Architecture for Medical Image Segmentation [J].
Zhou, Zongwei ;
Siddiquee, Md Mahfuzur Rahman ;
Tajbakhsh, Nima ;
Liang, Jianming .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 :3-11
[70]   Rubik's Cube plus : A self-supervised feature learning framework for 3D medical image analysis [J].
Zhu, Jiuwen ;
Li, Yuexiang ;
Hu, Yifan ;
Ma, Kai ;
Zhou, S. Kevin ;
Zheng, Yefeng .
MEDICAL IMAGE ANALYSIS, 2020, 64