FSS-2019-nCov: A deep learning architecture for semi-supervised few-shot segmentation of COVID-19 infection

被引:84
作者
Abdel-Basset, Mohamed [1 ]
Chang, Victor [2 ]
Hawash, Hossam [1 ]
Chakrabortty, Ripon K. [3 ]
Ryan, Michael [3 ]
机构
[1] Zagazig Univ, Fac Comp & Informat, Zagazig 44519, Sharqiyah, Egypt
[2] Teesside Univ, Sch Comp Engn & Digital Technol, Middlesbrough, Cleveland, England
[3] UNSW Canberra, Sch Engn & IT, Capabil Syst Ctr, Canberra, ACT, Australia
关键词
Deep learning; Few-shot segmentation; COVID-19; Context fusion; CT images; CHEST CT; IMAGES;
D O I
10.1016/j.knosys.2020.106647
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The newly discovered coronavirus (COVID-19) pneumonia is providing major challenges to research in terms of diagnosis and disease quantification. Deep-learning (DL) techniques allow extremely precise image segmentation; yet, they necessitate huge volumes of manually labeled data to be trained in a supervised manner. Few-Shot Learning (FSL) paradigms tackle this issue by learning a novel category from a small number of annotated instances. We present an innovative semi-supervised few-shot segmentation (FSS) approach for efficient segmentation of 2019-nCov infection (FSS-2019nCov) from only a few amounts of annotated lung CT scans. The key challenge of this study is to provide accurate segmentation of COVID-19 infection from a limited number of annotated instances. For that purpose, we propose a novel dual-path deep-learning architecture for FSS. Every path contains encoder-decoder (E-D) architecture to extract high-level information while maintaining the channel information of COVID-19 CT slices. The E-D architecture primarily consists of three main modules: a feature encoder module, a context enrichment (CE) module, and a feature decoder module. We utilize the pre-trained ResNet34 as an encoder backbone for feature extraction. The CE module is designated by a newly introduced proposed Smoothed Atrous Convolution (SAC) block and Multi-scale Pyramid Pooling (MPP) block. The conditioner path takes the pairs of CT images and their labels as input and produces a relevant knowledge representation that is transferred to the segmentation path to be used to segment the new images. To enable effective collaboration between both paths, we propose an adaptive recombination and recalibration (RR) module that permits intensive knowledge exchange between paths with a trivial increase in computational complexity. The model is extended to multi class labeling for various types of lung infections. This contribution overcomes the limitation of the lack of large numbers of COVID-19 CT scans. It also provides a general framework for lung disease diagnosis in limited data situations. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 61 条
[1]  
[Anonymous], 2020, IEEE T MED IMAGING, DOI DOI 10.1109/TMI.2020.2995965
[2]  
[Anonymous], 2019, IEEE T MED IMAGING, DOI DOI 10.1109/TMI.2018.2867261
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]  
Baur C., 2017, ARXIV170306000
[5]   Chest CT Findings in Coronavirus Disease 2019 (COVID-19): Relationship to Duration of Infection [J].
Bernheim, Adam ;
Mei, Xueyan ;
Huang, Mingqian ;
Yang, Yang ;
Fayad, Zahi A. ;
Zhang, Ning ;
Diao, Kaiyue ;
Lin, Bin ;
Zhu, Xiqi ;
Li, Kunwei ;
Li, Shaolin ;
Shan, Hong ;
Jacobi, Adam ;
Chung, Michael .
RADIOLOGY, 2020, 295 (03) :685-691
[6]   One-Shot Video Object Segmentation [J].
Caelles, S. ;
Maninis, K. -K. ;
Pont-Tuset, J. ;
Leal-Taixe, L. ;
Cremers, D. ;
Van Gool, L. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5320-5329
[7]   Meta-Seg: A Generalized Meta-Learning Framework for Multi-Class Few-Shot Semantic Segmentation [J].
Cao, Zhiying ;
Zhang, Tengfei ;
Diao, Wenhui ;
Zhang, Yue ;
Lyu, Xiaode ;
Fu, Kun ;
Sun, Xian .
IEEE ACCESS, 2019, 7 :166109-166121
[8]   Chest CT Features of COVID-19 in Rome, Italy [J].
Caruso, Damiano ;
Zerunian, Marta ;
Polici, Michela ;
Pucciarelli, Francesco ;
Polidori, Tiziano ;
Rucci, Carlotta ;
Guido, Gisella ;
Bracci, Benedetta ;
De Dominicis, Chiara ;
Laghi, Andrea .
RADIOLOGY, 2020, 296 (02) :E79-E85
[9]   Improve Student Performance Using Moderated Two-Stage Projects [J].
Chen, Juan ;
Cao, Yingjun ;
Du, Linlin ;
Ouyang, Youwen ;
Shen, Li .
PROCEEDINGS OF THE ACM CONFERENCE ON GLOBAL COMPUTING EDUCATION (COMPED '19), 2019, :201-207
[10]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851