Structure-preserving image translation for multi-source medical image domain adaptation

被引:13
作者
Kang, Myeongkyun [1 ]
Chikontwe, Philip [1 ]
Won, Dongkyu [1 ]
Luna, Miguel [1 ]
Park, Sang Hyun [1 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol DGIST, Dept Robot & Mechatron Engn, Daegu, South Korea
基金
新加坡国家研究基金会;
关键词
Domain adaptation; Data augmentation; Mutual information; Segmentation; Unpaired image translation; SEGMENTATION; ALIGNMENT; NETWORK;
D O I
10.1016/j.patcog.2023.109840
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Domain adaptation is an important task for medical image analysis to improve generalization on datasets collected from diverse institutes using different scanners and protocols. For images with visible domain shift, using image translation models is an intuitive and effective way to perform domain adaptation, but the structure of the generated image may often be distorted when large content discrepancies between domains exist; resulting in poor downstream task performance. To address this, we propose a novel image translation model that disentangles structure and texture to only transfer the latter by using mutual information and texture co-occurrence losses. We translate source domain images to the target domain and employ the generated results as augmented samples for domain adaptation segmentation training. We evaluate our method on three public segmentation datasets: MMWHS, Fundus, and Prostate datasets acquired from diverse institutes. Experimental results show that a segmentation model trained using the augmented images from our approach outperforms state-of-the-art domain adaptation, image translation, and domain generalization methods.
引用
收藏
页数:12
相关论文
共 60 条
[1]  
Belghazi MI, 2018, PR MACH LEARN RES, V80
[2]  
Chakravarty, 2015, JSM BIOMED IMAGING D, V2, P1004
[3]   Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation [J].
Chen, Cheng ;
Dou, Qi ;
Chen, Hao ;
Qin, Jing ;
Heng, Pheng Ann .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (07) :2494-2505
[4]  
Chen C, 2019, AAAI CONF ARTIF INTE, P865
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]  
Chen X, 2016, ADV NEUR IN, V29
[7]   Feature Re-calibration Based Multiple Instance Learning for Whole Slide Image Classification [J].
Chikontwe, Philip ;
Nam, Soo Jeong ;
Go, Heounjeong ;
Kim, Meejeong ;
Sung, Hyun Jung ;
Park, Sang Hyun .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 :420-430
[8]   Weakly supervised segmentation on neural compressed histopathology with self-equivariant regularization [J].
Chikontwe, Philip ;
Sung, Hyun Jung ;
Jeong, Jaehoon ;
Kim, Meejeong ;
Go, Heounjeong ;
Nam, Soo Jeong ;
Park, Sang Hyun .
MEDICAL IMAGE ANALYSIS, 2022, 80
[9]   StarGAN v2: Diverse Image Synthesis for Multiple Domains [J].
Choi, Yunjey ;
Uh, Youngjung ;
Yoo, Jaejun ;
Ha, Jung-Woo .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8185-8194
[10]   Bidirectional cross-modality unsupervised domain adaptation using generative adversarial networks for cardiac image segmentation [J].
Cui, Hengfei ;
Chang Yuwen ;
Lei Jiang ;
Yong Xia ;
Zhang, Yanning .
COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 136