Weakly Supervised Few-Shot Segmentation via Meta-Learning

被引:14
作者
Gama, Pedro H. T. [1 ]
Oliveira, Hugo [2 ]
Marcato Jr, Jose [3 ]
dos Santos, Jefersson A. [1 ]
机构
[1] Univ Fed Minas Gerais, Dept Comp Sci, BR-31270901 Belo Horizonte, Brazil
[2] Univ Sao, Inst Math & Stat IME, BR-05508060 Sao Paulo, Brazil
[3] Univ Fed Mato Grosso do Sul, Fac Engn Architecture & Urbanism & Geog, BR-79070900 Campo Grande, MS, Brazil
基金
巴西圣保罗研究基金会;
关键词
Image segmentation; Task analysis; Semantics; Annotations; Prototypes; Biomedical imaging; Training; Agriculture; few-shot; medical imaging analysis; meta learning; remote sensing; semantic segmentation; weakly supervised; IMAGES;
D O I
10.1109/TMM.2022.3162951
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Semantic segmentation is a classic computer vision task with multiple applications, which includes medical and remote sensing image analysis. Despite recent advances with deep-based approaches, labeling samples (pixels) for training models is laborious and, in some cases, unfeasible. In this paper, we present two novel meta-learning methods, named WeaSeL and ProtoSeg, for the few-shot semantic segmentation task with sparse annotations. We conducted an extensive evaluation of the proposed methods in different applications (12 datasets) in medical imaging and agricultural remote sensing, which are very distinct fields of knowledge and usually subject to data scarcity. The results demonstrated the potential of our method, achieving suitable results for segmenting both coffee/orange crops and anatomical parts of the human body in comparison with full dense annotation.
引用
收藏
页码:1784 / 1797
页数:14
相关论文
共 42 条
[21]   From 3D to 2D: Transferring knowledge for rib segmentation in chest X-rays [J].
Oliveira, Hugo ;
Mota, Virginia ;
Machado, Alexei M. C. ;
dos Santos, Jefersson A. .
PATTERN RECOGNITION LETTERS, 2020, 140 :10-17
[22]  
Penatti Otavio A. B., 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), P44, DOI 10.1109/CVPRW.2015.7301382
[23]  
Raghu A., 2020, PROC INT C LEARN REP
[24]  
Rakelly K., 2018, ICLR WORKSH
[25]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[26]   Development of a digital image database for chest radiographs with and without a lung nodule: Receiver operating characteristic analysis of radiologists' detection of pulmonary nodules [J].
Shiraishi, J ;
Katsuragawa, S ;
Ikezoe, J ;
Matsumoto, T ;
Kobayashi, T ;
Komatsu, K ;
Matsui, M ;
Fujita, H ;
Kodera, Y ;
Doi, K .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2000, 174 (01) :71-74
[27]   Automatic segmenting teeth in X-ray images: Trends, a novel data set, benchmarking and future perspectives [J].
Silva, Gil ;
Oliveira, Luciano ;
Pithon, Matheus .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 107 :15-31
[28]  
Silvestri G., 2018, P C MED IM DEEP LEAR, P1
[29]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[30]  
Snell J, 2017, ADV NEUR IN, V30