UPL-SFDA: Uncertainty-Aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation

被引:12
|
作者
Wu, Jianghao [1 ]
Wang, Guotai [1 ,2 ]
Gu, Ran [1 ]
Lu, Tao [3 ]
Chen, Yinan [4 ]
Zhu, Wentao [5 ]
Vercauteren, Tom [6 ]
Ourselin, Sebastien [6 ]
Zhang, Shaoting [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Univ Elect Sci & Technol China, Sichuan Prov Peoples Hosp, Dept Radiol, Chengdu 610072, Peoples R China
[4] SenseTime Res, Shanghai 200233, Peoples R China
[5] Zhejiang Lab, Res Ctr Healthcare Data Sci, Hangzhou 311100, Peoples R China
[6] Kings Coll London, Sch Biomed Engn & Imaging Sci, London WC2R 2LS, England
基金
中国国家自然科学基金;
关键词
Adaptation models; Predictive models; Image segmentation; Training; Entropy; Minimization; Head; Source-free domain adaptation; self-training; fetal MRI; heart MRI; entropy minimization; FETAL-BRAIN MRI;
D O I
10.1109/TMI.2023.3318364
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Domain Adaptation (DA) is important for deep learning-based medical image segmentation models to deal with testing images from a new target domain. As the source-domain data are usually unavailable when a trained model is deployed at a new center, Source-Free Domain Adaptation (SFDA) is appealing for data and annotation-efficient adaptation to the target domain. However, existing SFDA methods have a limited performance due to lack of sufficient supervision with source-domain images unavailable and target-domain images unlabeled. We propose a novel Uncertainty-aware Pseudo Label guided (UPL) SFDA method for medical image segmentation. Specifically, we propose Target Domain Growing (TDG) to enhance the diversity of predictions in the target domain by duplicating the pre-trained model's prediction head multiple times with perturbations. The different predictions in these duplicated heads are used to obtain pseudo labels for unlabeled target-domain images and their uncertainty to identify reliable pseudo labels. We also propose a Twice Forward pass Supervision (TFS) strategy that uses reliable pseudo labels obtained in one forward pass to supervise predictions in the next forward pass. The adaptation is further regularized by a mean prediction-based entropy minimization term that encourages confident and consistent results in different prediction heads. UPL-SFDA was validated with a multi-site heart MRI segmentation dataset, a cross-modality fetal brain segmentation dataset, and a 3D fetal tissue segmentation dataset. It improved the average Dice by 5.54, 5.01 and 6.89 percentage points for the three tasks compared with the baseline, respectively, and outperformed several state-of-the-art SFDA methods.
引用
收藏
页码:3932 / 3943
页数:12
相关论文
共 50 条
  • [31] Source-Free Domain Adaptation for Point Cloud Semantic Segmentation
    Duan, Jianshe
    Zhang, Yachao
    Qu, Yanyun
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024, 2024,
  • [32] Uncertainty-Induced Transferability Representation for Source-Free Unsupervised Domain Adaptation
    Pei, Jiangbo
    Jiang, Zhuqing
    Men, Aidong
    Chen, Liang
    Liu, Yang
    Chen, Qingchao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2033 - 2048
  • [33] Progressive Source-Aware Transformer for Generalized Source-Free Domain Adaptation
    Tang, Song
    Shi, Yuji
    Song, Zihao
    Ye, Mao
    Zhang, Changshui
    Zhang, Jianwei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4138 - 4152
  • [34] Uncertainty-Aware Training of Neural Networks for Selective Medical Image Segmentation
    Ding, Yukun
    Liu, Jinglan
    Xu, Xiaowei
    Huang, Meiping
    Zhuang, Jian
    Xiong, Jinjun
    Shi, Yiyu
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 121, 2020, 121 : 156 - 173
  • [35] Chaos to Order: A Label Propagation Perspective on Source-Free Domain Adaptation
    Wu, Chunwei
    Cao, Guitao
    Li, Yan
    Xi, Xidong
    Cao, Wenming
    Wang, Hong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 2877 - 2887
  • [36] Uncertainty-Aware Meta-weighted Optimization Framework for Domain-Generalized Medical Image Segmentation
    Oh, Seok-Hwan
    Jung, Guil
    Kim, Sang-Yun
    Kim, Myeong-Gee
    Kim, Young-Min
    Lee, Hyeon-Jik
    Kwon, Hyuk-Sool
    Bae, Hyeon-Min
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT IV, 2024, 15004 : 775 - 785
  • [37] Generation, augmentation, and alignment: a pseudo-source domain based method for source-free domain adaptation
    Yuntao Du
    Haiyang Yang
    Mingcai Chen
    Hongtao Luo
    Juan Jiang
    Yi Xin
    Chongjun Wang
    Machine Learning, 2024, 113 : 3611 - 3631
  • [38] De-confusing Pseudo-labels in Source-Free Domain Adaptation
    Diamant, Idit
    Rosenfeld, Amir
    Achituve, Idan
    Goldberger, Jacob
    Netzer, Arnon
    COMPUTER VISION - ECCV 2024, PT LXXIX, 2025, 15137 : 108 - 125
  • [39] Source-free domain adaptation framework based on confidence constrained mean teacher for fundus image segmentation
    Zhang, Yanqin
    Ma, Ding
    Wu, Xiangqian
    NEUROCOMPUTING, 2025, 620
  • [40] Generation, augmentation, and alignment: a pseudo-source domain based method for source-free domain adaptation
    Du, Yuntao
    Yang, Haiyang
    Chen, Mingcai
    Luo, Hongtao
    Jiang, Juan
    Xin, Yi
    Wang, Chongjun
    MACHINE LEARNING, 2024, 113 (06) : 3611 - 3631