Few-Shot Medical Image Segmentation via a Region-Enhanced Prototypical Transformer

被引:16
作者
Zhu, Yazhou [1 ]
Wang, Shidong [2 ]
Xin, Tong [3 ]
Zhang, Haofeng [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Newcastle Univ, Sch Engn, Newcastle Upon Tyne NE1 7RU, Tyne & Wear, England
[3] Newcastle Univ, Sch Comp, Newcastle Upon Tyne NE1 7RU, Tyne & Wear, England
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV | 2023年 / 14223卷
关键词
Few-Shot Learning; Medical Image Segmentation; Bias Alleviation; Transformer;
D O I
10.1007/978-3-031-43901-8_26
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Automated segmentation of large volumes of medical images is often plagued by the limited availability of fully annotated data and the diversity of organ surface properties resulting from the use of different acquisition protocols for different patients. In this paper, we introduce a more promising few-shot learning-based method named Region-enhanced Prototypical Transformer (RPT) to mitigate the effects of large intraclass diversity/bias. First, a subdivision strategy is introduced to produce a collection of regional prototypes from the foreground of the support prototype. Second, a self-selection mechanism is proposed to incorporate into the Bias-alleviated Transformer (BaT) block to suppress or remove interferences present in the query prototype and regional support prototypes. By stacking BaT blocks, the proposed RPT can iteratively optimize the generated regional prototypes and finally produce rectified and more accurate global prototypes for Few-Shot Medical Image Segmentation (FSMS). Extensive experiments are conducted on three publicly available medical image datasets, and the obtained results show consistent improvements compared to state-of-the-art FSMS methods. The source code is available at: https://github.com/YazhouZhu19/RPT.
引用
收藏
页码:271 / 280
页数:10
相关论文
共 24 条
[1]  
AURENHAMMER F, 1991, COMPUT SURV, V23, P345, DOI 10.1145/116873.116880
[2]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[3]   Few-shot Medical Image Segmentation with Cycle-resemblance Attention [J].
Ding, Hao ;
Sun, Changchang ;
Tang, Hao ;
Cai, Dawen ;
Yan, Yan .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :2487-2496
[4]   Interactive Few-Shot Learning: Limited Supervision, Better Medical Image Segmentation [J].
Feng, Ruiwei ;
Zheng, Xiangshang ;
Gao, Tianxiang ;
Chen, Jintai ;
Wang, Wenzhe ;
Chen, Danny Z. ;
Wu, Jian .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (10) :2575-2588
[5]   Anomaly detection-inspired few-shot medical image segmentation through self-supervision with supervoxels [J].
Hansen, Stine ;
Gautam, Srishti ;
Jenssen, Robert ;
Kampffmeyer, Michael .
MEDICAL IMAGE ANALYSIS, 2022, 78
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   CHAOS Challenge- combined (CT-MR) healthy abdominal organ segmentation [J].
Kavur, A. Emre ;
Gezer, N. Sinem ;
Baris, Mustafa ;
Aslan, Sinem ;
Conze, Pierre-Henri ;
Groza, Vladimir ;
Duc Duy Pham ;
Chatterjee, Soumick ;
Ernst, Philipp ;
Ozkan, Savas ;
Baydar, Bora ;
Lachinov, Dmitry ;
Han, Shuo ;
Pauli, Josef ;
Isensee, Fabian ;
Perkonigg, Matthias ;
Sathish, Rachana ;
Rajan, Ronnie ;
Sheet, Debdoot ;
Dovletov, Gurbandurdy ;
Speck, Oliver ;
Nurnberger, Andreas ;
Maier-Hein, Klaus H. ;
Akar, Gozde Bozdagi ;
Unal, Gozde ;
Dicle, Oguz ;
Selver, M. Alper .
MEDICAL IMAGE ANALYSIS, 2021, 69
[8]  
Kervadec H, 2019, PR MACH LEARN RES, V102, P285
[9]  
Landman B., 2015, P MICCAI MULT LAB CR, V5, P12
[10]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755