Uncertainty-aware domain alignment for anatomical structure segmentation

被引:48
作者
Bian, Cheng [1 ]
Yuan, Chenglang [1 ,4 ]
Wang, Jiexiang [1 ]
Li, Meng [2 ]
Yang, Xin [3 ]
Yu, Shuang [1 ]
Ma, Kai [1 ]
Yuan, Jin [2 ]
Zheng, Yefeng [1 ]
机构
[1] Tencent Jarvis Lab, Shenzhen 518057, Peoples R China
[2] Sunyat Sen Univ, Zhongshan Ophthalm Ctr, State Key Lab Ophthalmol, Guangzhou 510060, Peoples R China
[3] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong 999077, Peoples R China
[4] Shenzhen Univ, Sch Biomed Engn, Hlth Sci Ctr, Shenzhen 518071, Peoples R China
关键词
Uncertainty; Domain adaptation; Unsupervised segmentation; Deep learning; CHOROIDAL THICKNESS; IMAGE; OCT;
D O I
10.1016/j.media.2020.101732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic and accurate segmentation of anatomical structures on medical images is crucial for detecting various potential diseases. However, the segmentation performance of established deep neural networks may degenerate on different modalities or devices owing to the significant difference across the domains, a problem known as domain shift. In this work, we propose an uncertainty-aware domain alignment framework to address the domain shift problem in the cross-domain Unsupervised Domain Adaptation (UDA) task. Specifically, we design an Uncertainty Estimation and Segmentation Module (UESM) to obtain the uncertainty map estimation. Then, a novel Uncertainty-aware Cross Entropy (UCE) loss is proposed to leverage the uncertainty information to boost the segmentation performance on highly uncertain regions. To further improve the performance in the UDA task, an Uncertainty-aware Self-Training (UST) strategy is developed to choose the optimal target samples by uncertainty guidance. In addition, the Uncertainty Feature Recalibration Module (UFRM) is applied to enforce the framework to minimize the cross-domain discrepancy. The proposed framework is evaluated on a private cross-device Optical Coherence Tomography (OCT) dataset and a public cross-modality cardiac dataset released by MMWHS 2017. Extensive experiments indicate that the proposed UESM is both efficient and effective for the uncertainty estimation in the UDA task, achieving state-of-the-art performance on both cross-modality and cross-device datasets. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 48 条
[1]  
[Anonymous], 2018, Leveraging Uncertainty Estimates for Predicting Segmentation Quality
[2]   Review of brain MRI image segmentation methods [J].
Balafar, M. A. ;
Ramli, A. R. ;
Saripan, M. I. ;
Mashohor, S. .
ARTIFICIAL INTELLIGENCE REVIEW, 2010, 33 (03) :261-274
[3]  
Ben-Cohen A., 2017, RSIP VISION
[4]   All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation [J].
Chang, Wei-Lun ;
Wang, Hui-Po ;
Peng, Wen-Hsiao ;
Chiu, Wei-Chen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1900-1909
[5]  
Chen C, 2019, AAAI CONF ARTIF INTE, P865
[6]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[7]  
Chopra S, 2013, ICML WORKSH CHALL RE, V2
[8]   Unsupervised Domain Adaptation for Automatic Estimation of Cardiothoracic Ratio [J].
Dong, Nanqing ;
Kampffmeyer, Michael ;
Liang, Xiaodan ;
Wang, Zeya ;
Dai, Wei ;
Xing, Eric .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT II, 2018, 11071 :544-552
[9]  
Dou Q, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P691
[10]   Correlation between choroidal thickness and degree of myopia assessed with enhanced depth imaging optical coherence tomography [J].
El-Shazly, Amany A. ;
Farweez, Yousra A. ;
ElSebaay, Marwa E. ;
El-Zawahry, Walid M. A. .
EUROPEAN JOURNAL OF OPHTHALMOLOGY, 2017, 27 (05) :577-584