FPL plus : Filtered Pseudo Label-Based Unsupervised Cross-Modality Adaptation for 3D Medical Image Segmentation

被引:1
|
作者
Wu, Jianghao [1 ,2 ]
Guo, Dong [1 ]
Wang, Guotai [1 ,2 ]
Yue, Qiang [3 ]
Yu, Huijun [1 ]
Li, Kang [4 ]
Zhang, Shaoting [1 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Sichuan Univ, West China Hosp, Dept Radiol, Chengdu 610041, Peoples R China
[4] Sichuan Univ, West China Hosp, West China Biomed Big Data Ctr, Chengdu 610041, Peoples R China
[5] SenseTime Res, Shanghai 200233, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaption; image translation; uncertainty; brain tumor; pseudo labels; DOMAIN ADAPTATION; NETWORK; FRAMEWORK; NOISE;
D O I
10.1109/TMI.2024.3387415
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Adapting a medical image segmentation model to a new domain is important for improving its cross-domain transferability, and due to the expensive annotation process, Unsupervised Domain Adaptation (UDA) is appealing where only unlabeled images are needed for the adaptation. Existing UDA methods are mainly based on image or feature alignment with adversarial training for regularization, and they are limited by insufficient supervision in the target domain. In this paper, we propose an enhanced Filtered Pseudo Label (FPL+)-based UDA method for 3D medical image segmentation. It first uses cross-domain data augmentation to translate labeled images in the source domain to a dual-domain training set consisting of a pseudo source-domain set and a pseudo target-domain set. To leverage the dual-domain augmented images to train a pseudo label generator, domain-specific batch normalization layers are used to deal with the domain shift while learning the domain-invariant structure features, generating high-quality pseudo labels for target-domain images. We then combine labeled source-domain images and target-domain images with pseudo labels to train a final segmentor, where image-level weighting based on uncertainty estimation and pixel-level weighting based on dual-domain consensus are proposed to mitigate the adverse effect of noisy pseudo labels. Experiments on three public multi-modal datasets for Vestibular Schwannoma, brain tumor and whole heart segmentation show that our method surpassed ten state-of-the-art UDA methods, and it even achieved better results than fully supervised learning in the target domain in some cases.
引用
收藏
页码:3098 / 3109
页数:12
相关论文
共 50 条
  • [41] Unsupervised Domain Adaptation for 3D Medical Image with High Efficiency
    Deng, Chufu
    Li, Kuilin
    Chen, Zhiguang
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2021, 12712 LNAI : 104 - 116
  • [42] Unsupervised Domain Adaptation for 3D Medical Image with High Efficiency
    Deng, Chufu
    Li, Kuilin
    Chen, Zhiguang
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT I, 2021, 12712 : 104 - 116
  • [43] MAGNET: A MODALITY-AGNOSTIC NETWORK FOR 3D MEDICAL IMAGE SEGMENTATION
    He, A. Qisheng
    Dong, B. Ming
    Summerfield, C. Nicholas
    Glide-Hurst, D. Carri
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [44] 3D medical image segmentation approach based on multi-label front propagation
    Li, H
    Elmoataz, A
    Fadili, J
    Ruan, S
    Romaniuk, B
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 2925 - 2928
  • [45] ST-GAN: A Swin Transformer-Based Generative Adversarial Network for Unsupervised Domain Adaptation of Cross-Modality Cardiac Segmentation
    Zhang, Yifan
    Wang, Yonghui
    Xu, Lisheng
    Yao, Yudong
    Qian, Wei
    Qi, Lin
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (02) : 893 - 904
  • [46] UNETR plus plus : Delving Into Efficient and Accurate 3D Medical Image Segmentation
    Shaker, Abdelrahman
    Maaz, Muhammad
    Rasheed, Hanoona
    Khan, Salman
    Yang, Ming-Hsuan
    Khan, Fahad Shahbaz
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (09) : 3377 - 3390
  • [47] Unsupervised Cross-Modality Domain Adaptation for Vestibular Schwannoma Segmentation and Koos Grade Prediction Based on Semi-supervised Contrastive Learning
    Han, Luyi
    Huang, Yunzhi
    Tan, Tao
    Mann, Ritse
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2022, PT II, 2023, 14092 : 49 - 58
  • [48] Pseudo-label guided selective mutual learning for semi-supervised 3D medical image segmentation
    Hang, Wenlong
    Dai, Peng
    Pan, Chengao
    Liang, Shuang
    Zhang, Qingfeng
    Wu, Qiang
    Jin, Yukun
    Wang, Qiong
    Qin, Jing
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [49] PLS: UNSUPERVISED DOMAIN ADAPTATION FOR 3D OBJECT DETECTION VIA PSEUDO-LABEL SIZES
    Chen, Shijie
    Wang, Rongquan
    Li, Xin
    Wu, Yuchen
    Liu, Haizhuang
    Chen, Jiansheng
    Ma, Huimin
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6370 - 6374
  • [50] Deep Cross-Modality Adaptation via Semantics Preserving Adversarial Learning for Sketch-Based 3D Shape Retrieval
    Chen, Jiaxin
    Fang, Yi
    COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 : 624 - 640