Weakly Supervised Few-Shot Segmentation via Meta-Learning

被引:14
作者
Gama, Pedro H. T. [1 ]
Oliveira, Hugo [2 ]
Marcato Jr, Jose [3 ]
dos Santos, Jefersson A. [1 ]
机构
[1] Univ Fed Minas Gerais, Dept Comp Sci, BR-31270901 Belo Horizonte, Brazil
[2] Univ Sao, Inst Math & Stat IME, BR-05508060 Sao Paulo, Brazil
[3] Univ Fed Mato Grosso do Sul, Fac Engn Architecture & Urbanism & Geog, BR-79070900 Campo Grande, MS, Brazil
基金
巴西圣保罗研究基金会;
关键词
Image segmentation; Task analysis; Semantics; Annotations; Prototypes; Biomedical imaging; Training; Agriculture; few-shot; medical imaging analysis; meta learning; remote sensing; semantic segmentation; weakly supervised; IMAGES;
D O I
10.1109/TMM.2022.3162951
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Semantic segmentation is a classic computer vision task with multiple applications, which includes medical and remote sensing image analysis. Despite recent advances with deep-based approaches, labeling samples (pixels) for training models is laborious and, in some cases, unfeasible. In this paper, we present two novel meta-learning methods, named WeaSeL and ProtoSeg, for the few-shot semantic segmentation task with sparse annotations. We conducted an extensive evaluation of the proposed methods in different applications (12 datasets) in medical imaging and agricultural remote sensing, which are very distinct fields of knowledge and usually subject to data scarcity. The results demonstrated the potential of our method, achieving suitable results for segmenting both coffee/orange crops and anatomical parts of the human body in comparison with full dense annotation.
引用
收藏
页码:1784 / 1797
页数:14
相关论文
共 42 条
[1]   Automatic segmentation of mandible in panoramic x-ray [J].
Abdi, Amir Hossein ;
Kasaei, Shohreh ;
Mehdizadeh, Mojdeh .
JOURNAL OF MEDICAL IMAGING, 2015, 2 (04)
[2]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[3]   Recurrent Neural Networks for Aortic Image Sequence Segmentation with Sparse Annotations [J].
Bai, Wenjia ;
Suzuki, Hideaki ;
Qin, Chen ;
Tarroni, Giacomo ;
Oktay, Ozan ;
Matthews, Paul M. ;
Rueckert, Daniel .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 :586-594
[4]  
Bokhorst, 2018, INT C MED IM DEEP LE
[5]   Accurate Weakly-Supervised Deep Lesion Segmentation Using Large-Scale Clinical Annotations: Slice-Propagated 3D Mask Generation from 2D RECIST [J].
Cai, Jinzheng ;
Tang, Youbao ;
Lu, Le ;
Harrison, Adam P. ;
Yan, Ke ;
Xiao, Jing ;
Yang, Lin ;
Summers, Ronald M. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT IV, 2018, 11073 :396-404
[6]  
Cicek Ozgun, 2016, Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016. 19th International Conference. Proceedings: LNCS 9901, P424, DOI 10.1007/978-3-319-46723-8_49
[7]  
Dong Nanqing, 2018, BMVC, P79
[8]  
Ferreira E., 2018, P C IB C PATT REC, P72
[9]  
Finn C, 2017, PR MACH LEARN RES, V70
[10]   Learning to Segment Medical Images from Few-Shot Sparse Labels [J].
Gama, Pedro H. T. ;
Oliveira, Hugo ;
dos Santos, Jefersson A. .
2021 34TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2021), 2021, :89-96