FPL plus : Filtered Pseudo Label-Based Unsupervised Cross-Modality Adaptation for 3D Medical Image Segmentation

被引:1
|
作者
Wu, Jianghao [1 ,2 ]
Guo, Dong [1 ]
Wang, Guotai [1 ,2 ]
Yue, Qiang [3 ]
Yu, Huijun [1 ]
Li, Kang [4 ]
Zhang, Shaoting [1 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Peoples R China
[2] Shanghai AI Lab, Shanghai 200030, Peoples R China
[3] Sichuan Univ, West China Hosp, Dept Radiol, Chengdu 610041, Peoples R China
[4] Sichuan Univ, West China Hosp, West China Biomed Big Data Ctr, Chengdu 610041, Peoples R China
[5] SenseTime Res, Shanghai 200233, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaption; image translation; uncertainty; brain tumor; pseudo labels; DOMAIN ADAPTATION; NETWORK; FRAMEWORK; NOISE;
D O I
10.1109/TMI.2024.3387415
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Adapting a medical image segmentation model to a new domain is important for improving its cross-domain transferability, and due to the expensive annotation process, Unsupervised Domain Adaptation (UDA) is appealing where only unlabeled images are needed for the adaptation. Existing UDA methods are mainly based on image or feature alignment with adversarial training for regularization, and they are limited by insufficient supervision in the target domain. In this paper, we propose an enhanced Filtered Pseudo Label (FPL+)-based UDA method for 3D medical image segmentation. It first uses cross-domain data augmentation to translate labeled images in the source domain to a dual-domain training set consisting of a pseudo source-domain set and a pseudo target-domain set. To leverage the dual-domain augmented images to train a pseudo label generator, domain-specific batch normalization layers are used to deal with the domain shift while learning the domain-invariant structure features, generating high-quality pseudo labels for target-domain images. We then combine labeled source-domain images and target-domain images with pseudo labels to train a final segmentor, where image-level weighting based on uncertainty estimation and pixel-level weighting based on dual-domain consensus are proposed to mitigate the adverse effect of noisy pseudo labels. Experiments on three public multi-modal datasets for Vestibular Schwannoma, brain tumor and whole heart segmentation show that our method surpassed ten state-of-the-art UDA methods, and it even achieved better results than fully supervised learning in the target domain in some cases.
引用
收藏
页码:3098 / 3109
页数:12
相关论文
共 50 条
  • [31] Pseudo Label Refinery for Unsupervised Domain Adaptation on Cross-dataset 3D Object Detection
    Zhang, Zhanwei
    Chen, Minghao
    Xiao, Shuai
    Peng, Liang
    la Li, Hen
    Lin, Binbin
    Li, Ping
    Wang, Wenxiao
    Wu, Boxi
    Cai, Deng
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 15291 - 15300
  • [32] A bidirectional multilayer contrastive adaptation network with anatomical structure preservation for unpaired cross-modality medical image segmentation
    Liu, Hong
    Zhuang, Yuzhou
    Song, Enmin
    Xu, Xiangyang
    Hung, Chih-Cheng
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 149
  • [33] A 3-D Anatomy-Guided Self-Training Segmentation Framework for Unpaired Cross-Modality Medical Image Segmentation
    Zhuang, Yuzhou
    Liu, Hong
    Song, Enmin
    Xu, Xiangyang
    Liao, Yongde
    Ye, Guanchao
    Hung, Chih-Cheng
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2024, 8 (01) : 33 - 52
  • [34] StAC-DA: Structure aware cross-modality domain adaptation framework with image and feature-level adaptation for medical image segmentation
    Baldeon-Calisto, Maria
    Lai-Yuen, Susana K.
    Puente-Mejia, Bernardo
    DIGITAL HEALTH, 2024, 10
  • [35] A domain adaptation framework for cross-modality SAR 3D reconstruction point clouds segmentation utilizing LiDAR data
    Wang, Muhan
    Qiu, Xiaolan
    Zhang, Zhe
    Gao, Silin
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 133
  • [36] PSIGAN: Joint Probabilistic Segmentation and Image Distribution Matching for Unpaired Cross-Modality Adaptation-Based MRI Segmentation
    Jiang, Jue
    Hu, Yu-Chi
    Tyagi, Neelam
    Rimner, Andreas
    Lee, Nancy
    Deasy, Joseph O.
    Berry, Sean
    Veeraraghavan, Harini
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (12) : 4071 - 4084
  • [37] Koos Classification of Vestibular Schwannoma via Image Translation-Based Unsupervised Cross-Modality Domain Adaptation
    Yang, Tao
    Wang, Lisheng
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2022, PT II, 2023, 14092 : 59 - 67
  • [38] MA-SAM: Modality-agnostic SAM adaptation for 3D medical image segmentation
    Chen, Cheng
    Miao, Juzheng
    Wu, Dufan
    Zhong, Aoxiao
    Yan, Zhiling
    Kim, Sekeun
    Hu, Jiang
    Liu, Zhengliang
    Sun, Lichao
    Li, Xiang
    Liu, Tianming
    Heng, Pheng-Ann
    Li, Quanzheng
    MEDICAL IMAGE ANALYSIS, 2024, 98
  • [39] Unsupervised and Fully Autonomous 3D Medical Image Segmentation based on Grow Cut
    Marinescu, Alexandru-Ion
    Balint, Zoltan
    Diosan, Laura-Silvia
    Andreica, Anca-Mirela
    2018 20TH INTERNATIONAL SYMPOSIUM ON SYMBOLIC AND NUMERIC ALGORITHMS FOR SCIENTIFIC COMPUTING (SYNASC 2018), 2019, : 401 - 408
  • [40] Unsupervised Cross-Modality Person Re-identification Based on Semantic Pseudo-Label and Dual Feature Memory Banks
    Sun R.
    Yu Y.
    Zhang L.
    Zhang X.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2022, 35 (10): : 904 - 914