Domain adaptation based self-correction model for COVID-19 infection segmentation in CT images

被引:44
作者
Jin, Qiangguo [1 ,3 ]
Cui, Hui [2 ]
Sun, Changming [3 ]
Meng, Zhaopeng [1 ,4 ]
Wei, Leyi [5 ]
Su, Ran [1 ]
机构
[1] Tianjin Univ, Sch Comp Software, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic, Australia
[3] CSIRO Data61, Sydney, NSW, Australia
[4] Tianjin Univ Tradit Chinese Med, Tianjin, Peoples R China
[5] Shandong Univ, Sch Software, Jinan, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
COVID-19 CT segmentation; Domain adaptation; Self-correction learning; Attention mechanism; DIAGNOSIS;
D O I
10.1016/j.eswa.2021.114848
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The capability of generalization to unseen domains is crucial for deep learning models when considering realworld scenarios. However, current available medical image datasets, such as those for COVID-19 CT images, have large variations of infections and domain shift problems. To address this issue, we propose a prior knowledge driven domain adaptation and a dual-domain enhanced self-correction learning scheme. Based on the novel learning scheme, a domain adaptation based self-correction model (DASC-Net) is proposed for COVID-19 infection segmentation on CT images. DASC-Net consists of a novel attention and feature domain enhanced domain adaptation model (AFD-DA) to solve the domain shifts and a self-correction learning process to refine segmentation results. The innovations in AFD-DA include an image-level activation feature extractor with attention to lung abnormalities and a multi-level discrimination module for hierarchical feature domain alignment. The proposed self-correction learning process adaptively aggregates the learned model and corresponding pseudo labels for the propagation of aligned source and target domain information to alleviate the overfitting to noises caused by pseudo labels. Extensive experiments over three publicly available COVID-19 CT datasets demonstrate that DASC-Net consistently outperforms state-of-the-art segmentation, domain shift, and coronavirus infection segmentation methods. Ablation analysis further shows the effectiveness of the major components in our model. The DASC-Net enriches the theory of domain adaptation and self-correction learning in medical imaging and can be generalized to multi-site COVID-19 infection segmentation on CT images for clinical deployment.
引用
收藏
页数:12
相关论文
共 58 条
[1]   Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices [J].
Abramoff, Michael D. ;
Lavin, Philip T. ;
Birch, Michele ;
Shah, Nilay ;
Folk, James C. .
NPJ DIGITAL MEDICINE, 2018, 1
[2]   Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation [J].
Chen, Cheng ;
Dou, Qi ;
Chen, Hao ;
Qin, Jing ;
Heng, Pheng Ann .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (07) :2494-2505
[3]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[4]   Three-dimensional perception of orchard banana central stock enhanced by adaptive multi-vision technology [J].
Chen, Mingyou ;
Tang, Yunchao ;
Zou, Xiangjun ;
Huang, Kuangyu ;
Huang, Zhaofeng ;
Zhou, Hao ;
Wang, Chenglin ;
Lian, Guoping .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 174
[5]  
Chen Xinlei, 2020, AUTOPHAGY, DOI DOI 10.1080/15548627.2020.1810918
[6]   Domain Adaptive Image-to-image Translation [J].
Chen, Ying-Cong ;
Xu, Xiaogang ;
Jia, Jiaya .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5273-5282
[7]   CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency [J].
Chen, Yun-Chun ;
Lin, Yen-Yu ;
Yang, Ming-Hsuan ;
Huang, Jia-Bin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1791-1800
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]  
Dou Q, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P691
[10]   Unpaired Multi-Modal Segmentation via Knowledge Distillation [J].
Dou, Qi ;
Liu, Quande ;
Heng, Pheng Ann ;
Glocker, Ben .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (07) :2415-2425