Learning De-biased prototypes for Few-shot Medical Image Segmentation

被引:3
作者
Zhu, Yazhou [1 ]
Cheng, Ziming [1 ]
Wang, Shidong [2 ]
Zhang, Haofeng [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Newcastle Univ, Sch Engn, Newcastle Upon Tyne NE1 7RU, England
基金
中国国家自然科学基金;
关键词
Few-shot learning; Medical image segmentation; De-biased prototypes; Learnable threshold; SEMANTIC SEGMENTATION;
D O I
10.1016/j.patrec.2024.05.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Prototypical networks have emerged as the dominant method for Few-shot Medical image Segmentation (FSMIS). Despite their success, the commonly used Masked Average Pooling (MAP) approach in prototypical networks computes the mean of the masks, resulting in imprecise and inadequate prototypes that fail to capture the subtle nuances and variations in the data. To address this issue, we propose a simple yet effective module called De-biasing Masked Average Pooling (DMAP) to generate more accurate prototypes from filtered foreground support features. Specifically, our approach introduces a Learnable Threshold Generation (LTG) module that adaptively learns a threshold based on the extracted features from both support and query images, and then choose partial foreground pixels that have larger similarity than the threshold to generate prototypes. Our proposed method is evaluated on three popular medical image segmentation datasets, and the results demonstrate the superiority of our approach over some state-of-the-art methods. Code is available at https://github.com/YazhouZhu19/DMAP.
引用
收藏
页码:71 / 77
页数:7
相关论文
共 41 条
[1]   Domain Adaptation Meets Zero-Shot Learning: An Annotation-Efficient Approach to Multi-Modality Medical Image Segmentation [J].
Bian, Cheng ;
Yuan, Chenglang ;
Ma, Kai ;
Yu, Shuang ;
Wei, Dong ;
Zheng, Yefeng .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (05) :1043-1056
[2]  
Boyu Yang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12353), P763, DOI 10.1007/978-3-030-58598-3_45
[3]  
Cheng Ouyang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12374), P762, DOI 10.1007/978-3-030-58526-6_45
[4]   Few-Shot Medical Image Segmentation via Generating Multiple Representative Descriptors [J].
Cheng, Ziming ;
Wang, Shidong ;
Xin, Tong ;
Zhou, Tao ;
Zhang, Haofeng ;
Shao, Ling .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (06) :2202-2214
[5]   Few-shot hypercolumn-based mitochondria segmentation in cardiac and outer hair cells in focused ion beam-scanning electron microscopy (FIB-SEM) data [J].
Dietlmeier, Julia ;
McGuinness, Kevin ;
Rugonyi, Sandra ;
Wilson, Teresa ;
Nuttall, Alfred ;
O'Connor, Noel E. .
PATTERN RECOGNITION LETTERS, 2019, 128 :521-528
[6]   Few-shot Medical Image Segmentation with Cycle-resemblance Attention [J].
Ding, Hao ;
Sun, Changchang ;
Tang, Hao ;
Cai, Dawen ;
Yan, Yan .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :2487-2496
[7]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[8]   Anomaly detection-inspired few-shot medical image segmentation through self-supervision with supervoxels [J].
Hansen, Stine ;
Gautam, Srishti ;
Jenssen, Robert ;
Kampffmeyer, Michael .
MEDICAL IMAGE ANALYSIS, 2022, 78
[9]  
Hu Z., 2022, PROC INT C LEARN REP
[10]   nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation [J].
Isensee, Fabian ;
Jaeger, Paul F. ;
Kohl, Simon A. A. ;
Petersen, Jens ;
Maier-Hein, Klaus H. .
NATURE METHODS, 2021, 18 (02) :203-+