Generalizable Medical Image Segmentation via Random Amplitude Mixup and Domain-Specific Image Restoration

被引:36
作者
Zhou, Ziqi [1 ,2 ]
Qi, Lei [3 ]
Shi, Yinghuan [1 ,2 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] Nanjing Univ, Natl Inst Healthcare Data Sci, Nanjing, Peoples R China
[3] Southeast Univ, Sch Comp Sci & Engn, Dhaka, Bangladesh
来源
COMPUTER VISION, ECCV 2022, PT XXI | 2022年 / 13681卷
基金
中国博士后科学基金;
关键词
Medical image segmentation; Domain generalization; Self-supervision; INFORMATION;
D O I
10.1007/978-3-031-19803-8_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For medical image analysis, segmentation models trained on one or several domains lack generalization ability to unseen domains due to discrepancies between different data acquisition policies. We argue that the degeneration in segmentation performance is mainly attributed to overfitting to source domains and domain shift. To this end, we present a novel generalizable medical image segmentation method. To be specific, we design our approach as a multi-task paradigm by combining the segmentation model with a self-supervision domain-specific image restoration (DSIR) module for model regularization. We also design a random amplitude mixup (RAM) module, which incorporates low-level frequency information of different domain images to synthesize new images. To guide our model be resistant to domain shift, we introduce a semantic consistency loss. We demonstrate the performance of our method on two public generalizable segmentation benchmarks in medical images, which validates our method could achieve the state-of-the-art performance. (Code is available at https://github.com/zzzqzhou/RAM-DSIR).
引用
收藏
页码:420 / 436
页数:17
相关论文
共 43 条
[1]  
Balaji Y., 2018, METAREG DOMAIN GENER
[2]  
Bao Hangbo, 2022, ICLR
[3]   Domain Generalization by Solving Jigsaw Puzzles [J].
Carlucci, Fabio M. ;
D'Innocente, Antonio ;
Bucci, Silvia ;
Caputo, Barbara ;
Tommasi, Tatiana .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2224-2233
[4]   All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation [J].
Chang, Wei-Lun ;
Wang, Hui-Po ;
Peng, Wen-Hsiao ;
Chiu, Wei-Chen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1900-1909
[5]   Learning to Balance Specificity and Invariance for In and Out of Domain Generalization [J].
Chattopadhyay, Prithvijit ;
Balaji, Yogesh ;
Hoffman, Judy .
COMPUTER VISION - ECCV 2020, PT IX, 2020, 12354 :301-318
[6]  
Chen C, 2019, AAAI CONF ARTIF INTE, P865
[7]   Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learning [J].
Chen, Yuhua ;
Pont-Tuset, Jordi ;
Montes, Alberto ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1189-1198
[8]   Graph-Based Global Reasoning Networks [J].
Chen, Yunpeng ;
Rohrbach, Marcus ;
Yan, Zhicheng ;
Yan, Shuicheng ;
Feng, Jiashi ;
Kalantidis, Yannis .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :433-442
[9]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[10]  
Dou Q, 2019, ADV NEUR IN, V32