FPL plus : Filtered Pseudo Label-Based Unsupervised Cross-Modality Adaptation for 3D Medical Image Segmentation

被引:1
|
作者
Wu, Jianghao [1 ,2 ]
Guo, Dong [1 ]
Wang, Guotai [1 ,2 ]
Yue, Qiang [3 ]
Yu, Huijun [1 ]
Li, Kang [4 ]
Zhang, Shaoting [1 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Sichuan Univ, West China Hosp, Dept Radiol, Chengdu 610041, Peoples R China
[4] Sichuan Univ, West China Hosp, West China Biomed Big Data Ctr, Chengdu 610041, Peoples R China
[5] SenseTime Res, Shanghai 200233, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaption; image translation; uncertainty; brain tumor; pseudo labels; DOMAIN ADAPTATION; NETWORK; FRAMEWORK; NOISE;
D O I
10.1109/TMI.2024.3387415
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Adapting a medical image segmentation model to a new domain is important for improving its cross-domain transferability, and due to the expensive annotation process, Unsupervised Domain Adaptation (UDA) is appealing where only unlabeled images are needed for the adaptation. Existing UDA methods are mainly based on image or feature alignment with adversarial training for regularization, and they are limited by insufficient supervision in the target domain. In this paper, we propose an enhanced Filtered Pseudo Label (FPL+)-based UDA method for 3D medical image segmentation. It first uses cross-domain data augmentation to translate labeled images in the source domain to a dual-domain training set consisting of a pseudo source-domain set and a pseudo target-domain set. To leverage the dual-domain augmented images to train a pseudo label generator, domain-specific batch normalization layers are used to deal with the domain shift while learning the domain-invariant structure features, generating high-quality pseudo labels for target-domain images. We then combine labeled source-domain images and target-domain images with pseudo labels to train a final segmentor, where image-level weighting based on uncertainty estimation and pixel-level weighting based on dual-domain consensus are proposed to mitigate the adverse effect of noisy pseudo labels. Experiments on three public multi-modal datasets for Vestibular Schwannoma, brain tumor and whole heart segmentation show that our method surpassed ten state-of-the-art UDA methods, and it even achieved better results than fully supervised learning in the target domain in some cases.
引用
收藏
页码:3098 / 3109
页数:12
相关论文
共 50 条
  • [1] FPL-UDA: FILTERED PSEUDO LABEL-BASED UNSUPERVISED CROSS-MODALITY ADAPTATION FOR VESTIBULAR SCHWANNOMA SEGMENTATION
    Wu, Jianghao
    Gu, Ran
    Dong, Guiming
    Wang, Guotai
    Zhang, Shaoting
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [2] A Novel 3D Unsupervised Domain Adaptation Framework for Cross-Modality Medical Image Segmentation
    Yao, Kai
    Su, Zixian
    Huang, Kaizhu
    Yang, Xi
    Sun, Jie
    Hussain, Amir
    Coenen, Frans
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (10) : 4976 - 4986
  • [3] Unsupervised Cross-Modality Adaptation via Dual Structural-Oriented Guidance for 3D Medical Image Segmentation
    Xian, Junlin
    Li, Xiang
    Tu, Dandan
    Zhu, Senhua
    Zhang, Changzheng
    Liu, Xiaowu
    Li, Xin
    Yang, Xin
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (06) : 1774 - 1785
  • [4] Semantic Consistent Unsupervised Domain Adaptation for Cross-Modality Medical Image Segmentation
    Zeng, Guodong
    Lerch, Till D.
    Schmaranzer, Florian
    Zheng, Guoyan
    Burger, Juergen
    Gerber, Kate
    Tannast, Moritz
    Siebenrock, Klaus
    Gerber, Nicolas
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 201 - 210
  • [5] Data Efficient Unsupervised Domain Adaptation For Cross-modality Image Segmentation
    Ouyang, Cheng
    Kamnitsas, Konstantinos
    Biffi, Carlo
    Duan, Jinming
    Rueckert, Daniel
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 669 - 677
  • [6] Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation
    Chen, Cheng
    Dou, Qi
    Chen, Hao
    Qin, Jing
    Heng, Pheng Ann
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (07) : 2494 - 2505
  • [7] DDA-Net: Unsupervised cross-modality medical image segmentation via dual domain adaptation
    Bian, Xuesheng
    Luo, Xiongbiao
    Wang, Cheng
    Liu, Weiquan
    Lin, Xiuhong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 213
  • [8] C-MADA: Unsupervised Cross-Modality Adversarial Domain Adaptation framework for Medical Image Segmentation
    Baldeon Calisto, Maria G.
    Lai-Yuen, Susana K.
    MEDICAL IMAGING 2022: IMAGE PROCESSING, 2022, 12032
  • [9] Deep Symmetric Adaptation Network for Cross-Modality Medical Image Segmentation
    Han, Xiaoting
    Qi, Lei
    Yu, Qian
    Zhou, Ziqi
    Zheng, Yefeng
    Shi, Yinghuan
    Gao, Yang
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (01) : 121 - 132
  • [10] Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentation
    Chen, Cheng
    Dou, Qi
    Chen, Hao
    Qin, Jing
    Heng, Pheng-Ann
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 865 - 872