Dual-Guided Prototype Alignment Network for Few-Shot Medical Image Segmentation

被引:0
作者
Shen, Yue [1 ]
Fan, Wanshu [1 ]
Wang, Cong [2 ]
Liu, Wenfei [3 ]
Wang, Wei [4 ]
Zhang, Qiang [1 ,5 ]
Zhou, Dongsheng [1 ,5 ]
机构
[1] Dalian Univ, Sch Software Engn, Natl & Local Joint Engn Lab Comp Aided Design, Dalian 116622, Peoples R China
[2] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[3] Dalian Univ, Dept Radiol, Affiliated Zhongshan Hosp, Dalian 116001, Peoples R China
[4] Sun Yat Sen Univ, Sch Cyber Sci & Technol, Shenzhen 510275, Peoples R China
[5] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
关键词
Prototypes; Image segmentation; Medical diagnostic imaging; Three-dimensional displays; Feature extraction; Training; Task analysis; Adaptive prototype; dual optimization (DO); few-shot learning (FSL); medical image segmentation; prototype alignment;
D O I
10.1109/TIM.2024.3411136
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Given the hurdles of limited data availability, annotation challenges, and constrained generalization capabilities in medical image segmentation, few-shot learning (FSL) has become a prominent approach due to its efficacy in learning new categories from minimal annotated samples. Existing methods predominantly adopt the support-guided paradigm, wherein support prototypes, derived from annotated support images, guide the segmentation of unlabeled query images. This approach, however, is prone to local information loss and classification bias. To counter these challenges, we introduce a novel dual-guided prototype alignment network (DGPANet) that integrates a bidirectional segmentation architecture. The support-to-query branch incorporates query guidance information into the conventional support-guided approach for segmenting query images, whereas the complementary query-to-support branch segments support images in reverse with the dual guidance provided. This design not only optimizes our network but also alleviates segmentation biases pertaining to support category objects. Furthermore, we propose an adaptive prototype module (APM) to foster information amalgamation by adaptively clustering analogous elements. Moreover, we propose an adaptive prototype alignment loss to better improve the dual optimization (DO) procedure. Extensive experiments show that our proposed DGPANet favors against state-of-the-art (SOTA) approaches on three public datasets, including abdominal-computed tomography (CT), abdominal-magnetic resonance imaging (MRI), and Cardiac-MRI. Codes are at https://github.com/shiyi0306/DGPANet.
引用
收藏
页数:13
相关论文
共 54 条
  • [1] Sleep Apnea Detection From Single-Lead ECG: A Comprehensive Analysis of Machine Learning and Deep Learning Algorithms
    Bahrami, Mahsa
    Forouzanfar, Mohamad
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] Triplet-Graph Reasoning Network for Few-Shot Metal Generic Surface Defect Segmentation
    Bao, Yanqi
    Song, Kechen
    Liu, Jie
    Wang, Yanyan
    Yan, Yunhui
    Yu, Han
    Li, Xingjie
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [3] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [4] Boyu Yang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12353), P763, DOI 10.1007/978-3-030-58598-3_45
  • [5] Cheng Ouyang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12374), P762, DOI 10.1007/978-3-030-58526-6_45
  • [6] Cicek Ozgun, 2016, Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016. 19th International Conference. Proceedings: LNCS 9901, P424, DOI 10.1007/978-3-319-46723-8_49
  • [7] Few-shot Medical Image Segmentation with Cycle-resemblance Attention
    Ding, Hao
    Sun, Changchang
    Tang, Hao
    Cai, Dawen
    Yan, Yan
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2487 - 2496
  • [8] Dong N., 2018, BMVC, V3, P79
  • [9] Self-support Few-Shot Semantic Segmentation
    Fan, Qi
    Pei, Wenjie
    Tai, Yu-Wing
    Tang, Chi-Keung
    [J]. COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 701 - 719
  • [10] Goldblum M, 2020, ADV NEUR IN, V33