FPL plus : Filtered Pseudo Label-Based Unsupervised Cross-Modality Adaptation for 3D Medical Image Segmentation

被引:1
|
作者
Wu, Jianghao [1 ,2 ]
Guo, Dong [1 ]
Wang, Guotai [1 ,2 ]
Yue, Qiang [3 ]
Yu, Huijun [1 ]
Li, Kang [4 ]
Zhang, Shaoting [1 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Sichuan Univ, West China Hosp, Dept Radiol, Chengdu 610041, Peoples R China
[4] Sichuan Univ, West China Hosp, West China Biomed Big Data Ctr, Chengdu 610041, Peoples R China
[5] SenseTime Res, Shanghai 200233, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaption; image translation; uncertainty; brain tumor; pseudo labels; DOMAIN ADAPTATION; NETWORK; FRAMEWORK; NOISE;
D O I
10.1109/TMI.2024.3387415
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Adapting a medical image segmentation model to a new domain is important for improving its cross-domain transferability, and due to the expensive annotation process, Unsupervised Domain Adaptation (UDA) is appealing where only unlabeled images are needed for the adaptation. Existing UDA methods are mainly based on image or feature alignment with adversarial training for regularization, and they are limited by insufficient supervision in the target domain. In this paper, we propose an enhanced Filtered Pseudo Label (FPL+)-based UDA method for 3D medical image segmentation. It first uses cross-domain data augmentation to translate labeled images in the source domain to a dual-domain training set consisting of a pseudo source-domain set and a pseudo target-domain set. To leverage the dual-domain augmented images to train a pseudo label generator, domain-specific batch normalization layers are used to deal with the domain shift while learning the domain-invariant structure features, generating high-quality pseudo labels for target-domain images. We then combine labeled source-domain images and target-domain images with pseudo labels to train a final segmentor, where image-level weighting based on uncertainty estimation and pixel-level weighting based on dual-domain consensus are proposed to mitigate the adverse effect of noisy pseudo labels. Experiments on three public multi-modal datasets for Vestibular Schwannoma, brain tumor and whole heart segmentation show that our method surpassed ten state-of-the-art UDA methods, and it even achieved better results than fully supervised learning in the target domain in some cases.
引用
收藏
页码:3098 / 3109
页数:12
相关论文
共 50 条
  • [21] Bidirectional cross-modality unsupervised domain adaptation using generative adversarial networks for cardiac image segmentation
    Cui, Hengfei
    Chang Yuwen
    Lei Jiang
    Yong Xia
    Zhang, Yanning
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 136
  • [22] Cross-modality cerebrovascular segmentation based on pseudo-label generation via paired data
    Guo, Zhanqiang
    Feng, Jianjiang
    Lu, Wangsheng
    Yin, Yin
    Yang, Guangming
    Zhou, Jie
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 115
  • [23] C3R: Category contrastive adaptation and consistency regularization for cross-modality medical image segmentation
    Ding, Shaodong
    Liu, Ziyang
    Liu, Pan
    Zhu, Wanlin
    Xu, Hong
    Li, Zixiao
    Niu, Haijun
    Cheng, Jian
    Liu, Tao
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 269
  • [24] MT-UDA: Towards Unsupervised Cross-modality Medical Image Segmentation with Limited Source Labels
    Zhao, Ziyuan
    Xu, Kaixin
    Li, Shumeng
    Zeng, Zeng
    Guan, Cuntai
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 293 - 303
  • [25] MAPSeg: Unified Unsupervised Domain Adaptation for Heterogeneous Medical Image Segmentation Based on 3D Masked Autoencoding and Pseudo-Labeling
    Zhang, Xuzhe
    Wu, Yuhao
    Angelini, Elsa
    Li, Ang
    Guo, Jia
    Rasmussen, Jerod M.
    O'Connor, Thomas G.
    Wadhwa, Pathik D.
    Jackowski, Andrea Parolin
    Li, Hai
    Posner, Jonathan
    Laine, Andrew F.
    Wang, Yun
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 5851 - 5862
  • [26] SDC-UDA: Volumetric Unsupervised Domain Adaptation Framework for Slice-Direction Continuous Cross-Modality Medical Image Segmentation
    Shin, Hyungseob
    Kim, Hyeongyu
    Kim, Sewon
    Jun, Yohan
    Eo, Taejoon
    Hwang, Dosik
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7412 - 7421
  • [27] Cache-Driven Spatial Test-Time Adaptation for Cross-Modality Medical Image Segmentation
    Li, Xiang
    Fang, Huihui
    Wang, Changmiao
    Liu, Mingsi
    Duan, Lixin
    Xu, Yanwu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 146 - 156
  • [28] Reducing Domain Gap in Frequency and Spatial Domain for Cross-Modality Domain Adaptation on Medical Image Segmentation
    Liu, Shaolei
    Yin, Siqi
    Qu, Linhao
    Wang, Manning
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 1719 - 1727
  • [29] Mx2M: Masked Cross-Modality Modeling in Domain Adaptation for 3D Semantic Segmentation
    Zhang, Boxiang
    Wang, Zunran
    Ling, Yonggen
    Guan, Yuanyuan
    Zhang, Shenghao
    Li, Wenhui
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3401 - 3409
  • [30] Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation
    Tseng, Kuan-Lun
    Lin, Yen-Liang
    Hsu, Winston
    Huang, Chung-Yang
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3739 - 3746