Self-supervision with Superpixels: Training Few-Shot Medical Image Segmentation Without Annotation

被引:146
作者
Ouyang, Cheng [1 ]
Biffi, Carlo [1 ]
Chen, Chen [1 ]
Kart, Turkay [1 ]
Qiu, Huaqi [1 ]
Rueckert, Daniel [1 ]
机构
[1] Imperial Coll London, Dept Comp, BioMedIA Grp, London, England
来源
COMPUTER VISION - ECCV 2020, PT XXIX | 2020年 / 12374卷
基金
英国科研创新办公室; 英国工程与自然科学研究理事会;
关键词
D O I
10.1007/978-3-030-58526-6_45
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot semantic segmentation (FSS) has great potential for medical imaging applications. Most of the existing FSS techniques require abundant annotated semantic classes for training. However, these methods may not be applicable for medical images due to the lack of annotations. To address this problem we make several contributions: (1) A novel self-supervised FSS framework for medical images in order to eliminate the requirement for annotations during training. Additionally, superpixel-based pseudo-labels are generated to provide supervision; (2) An adaptive local prototype pooling module plugged into prototypical networks, to solve the common challenging foreground-background imbalance problem in medical image segmentation; (3) We demonstrate the general applicability of the proposed approach for medical images using three different tasks: abdominal organ segmentation for CT and MRI, as well as cardiac segmentation for MRI. Our results show that, for medical image segmentation, the proposed method outperforms conventional FSS methods which require manual annotations for training.
引用
收藏
页码:762 / 780
页数:19
相关论文
共 76 条
[1]  
Achanta R., 2010, Tech. rep.
[2]  
Bachman P, 2019, ADV NEUR IN, V32
[3]   Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction [J].
Bai, Wenjia ;
Chen, Chen ;
Tarroni, Giacomo ;
Duan, Jinming ;
Guitton, Florian ;
Petersen, Steffen E. ;
Guo, Yike ;
Matthews, Paul M. ;
Rueckert, Daniel .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 :541-549
[4]  
Chen C, 2020, Arxiv, DOI arXiv:2006.13322
[5]   Self-supervised learning for medical image analysis using image context restoration [J].
Chen, Liang ;
Bentley, Paul ;
Mori, Kensaku ;
Misawa, Kazunari ;
Fujiwara, Michitaka ;
Rueckert, Daniel .
MEDICAL IMAGE ANALYSIS, 2019, 58
[6]  
Chen XL, 2020, Arxiv, DOI arXiv:2003.04297
[7]   Prevalence of cerebral white matter lesions in elderly people: a population based magnetic resonance imaging study. The Rotterdam Scan Study [J].
de Leeuw, FE ;
de Groot, JC ;
Achten, E ;
Oudkerk, M ;
Ramos, LMP ;
Heijboer, R ;
Hofman, A ;
Jolles, J ;
van Gijn, J ;
Breteler, MMB .
JOURNAL OF NEUROLOGY NEUROSURGERY AND PSYCHIATRY, 2001, 70 (01) :9-14
[8]   Multi-task Self-Supervised Visual Learning [J].
Doersch, Carl ;
Zisserman, Andrew .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2070-2079
[9]   Unsupervised Visual Representation Learning by Context Prediction [J].
Doersch, Carl ;
Gupta, Abhinav ;
Efros, Alexei A. .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1422-1430
[10]  
Dong N., 2018, BMVC, V3