MT-nCov-Net: A Multitask Deep-Learning Framework for Efficient Diagnosis of COVID-19 Using Tomography Scans

被引:19
作者
Ding, Weiping [1 ]
Abdel-Basset, Mohamed [2 ]
Hawash, Hossam [2 ]
Elkomy, Osama M. [3 ]
机构
[1] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
[2] Zagazig Univ, Dept Comp Sci, Zagazig 44159, Egypt
[3] Zagazig Univ, Dept Informat Technol, Zagazig 44159, Egypt
基金
中国国家自然科学基金;
关键词
Lesions; COVID-19; Computed tomography; Image segmentation; Location awareness; Shape; Task analysis; Coronavirus disease 19 (COVID-19); deep learning (DL); lesion localization; lesion segmentation; multitask learning; SEGMENTATION; NETWORK; CLASSIFICATION; LOCALIZATION; ACCURATE; FEATURES; SPINE;
D O I
10.1109/TCYB.2021.3123173
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The localization and segmentation of the novel coronavirus disease of 2019 (COVID-19) lesions from computerized tomography (CT) scans are of great significance for developing an efficient computer-aided diagnosis system. Deep learning (DL) has emerged as one of the best choices for developing such a system. However, several challenges limit the efficiency of DL approaches, including data heterogeneity, considerable variety in the shape and size of the lesions, lesion imbalance, and scarce annotation. In this article, a novel multitask regression network for segmenting COVID-19 lesions is proposed to address these challenges. We name the framework MT-nCov-Net. We formulate lesion segmentation as a multitask shape regression problem that enables partaking the poor-, intermediate-, and high-quality features between various tasks. A multiscale feature learning (MFL) module is presented to capture the multiscale semantic information, which helps to efficiently learn small and large lesion features while reducing the semantic gap between different scale representations. In addition, a fine-grained lesion localization (FLL) module is introduced to detect infection lesions using an adaptive dual-attention mechanism. The generated location map and the fused multiscale representations are subsequently passed to the lesion regression (LR) module to segment the infection lesions. MT-nCov-Net enables learning complete lesion properties to accurately segment the COVID-19 lesion by regressing its shape. MT-nCov-Net is experimentally evaluated on two public multisource datasets, and the overall performance validates its superiority over the current cutting-edge approaches and demonstrates its effectiveness in tackling the problems facing the diagnosis of COVID-19.
引用
收藏
页码:1285 / 1298
页数:14
相关论文
共 39 条
[1]   Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: Classification and segmentation [J].
Amyar, Amine ;
Modzelewski, Romain ;
Li, Hua ;
Ruan, Su .
COMPUTERS IN BIOLOGY AND MEDICINE, 2020, 126
[2]   AI-driven quantification, staging and outcome prediction of COVID-19 pneumonia [J].
Chassagnon, Guillaume ;
Vakalopoulou, Maria ;
Battistella, Enzo ;
Christodoulidis, Stergios ;
Trieu-Nghi Hoang-Thi ;
Dangeard, Severine ;
Deutsch, Eric ;
Andre, Fabrice ;
Guillo, Enora ;
Halm, Nara ;
El Hajj, Stefany ;
Bompard, Florian ;
Neveu, Sophie ;
Hani, Chahinez ;
Saab, Ines ;
Campredon, Alienor ;
Koulakian, Hasmik ;
Bennani, Souhail ;
Freche, Gael ;
Barat, Maxime ;
Lombard, Aurelien ;
Fournier, Laure ;
Monnier, Hippolyte ;
Grand, Teodor ;
Gregory, Jules ;
Nguyen, Yann ;
Khalil, Antoine ;
Mahdjoub, Elyas ;
Brillet, Pierre-Yves ;
Ba, Stephane Tran ;
Bousson, Valerie ;
Mekki, Ahmed ;
Carlier, Robert-Yves ;
Revel, Marie-Pierre ;
Paragios, Nikos .
MEDICAL IMAGE ANALYSIS, 2021, 67
[3]   δ-Norm-Based Robust Regression With Applications to Image Analysis [J].
Chen, Shuo ;
Yang, Jian ;
Wei, Yang ;
Luo, Lei ;
Lu, Gui-Fu ;
Gong, Chen .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (06) :3371-3383
[4]   Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images [J].
Fan, Deng-Ping ;
Zhou, Tao ;
Ji, Ge-Peng ;
Zhou, Yi ;
Chen, Geng ;
Fu, Huazhu ;
Shen, Jianbing ;
Shao, Ling .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (08) :2626-2637
[5]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[6]   Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images [J].
Gao, Kai ;
Su, Jianpo ;
Jiang, Zhongbiao ;
Zeng, Ling-Li ;
Feng, Zhichao ;
Shen, Hui ;
Rong, Pengfei ;
Xu, Xin ;
Qin, Jian ;
Yang, Yuexiang ;
Wang, Wei ;
Hu, Dewen .
MEDICAL IMAGE ANALYSIS, 2021, 67
[7]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[8]   Position paper on COVID-19 imaging and AI: From the clinical needs and technological challenges to initial AI solutions at the lab and national level towards a new era for AI in healthcare [J].
Greenspan, Hayit ;
Estepar, Raul San Jose ;
Niessen, Wiro J. ;
Siegel, Eliot ;
Nielsen, Mads .
MEDICAL IMAGE ANALYSIS, 2020, 66 (66)
[9]   CE-Net: Context Encoder Network for 2D Medical Image Segmentation [J].
Gu, Zaiwang ;
Cheng, Jun ;
Fu, Huazhu ;
Zhou, Kang ;
Hao, Huaying ;
Zhao, Yitian ;
Zhang, Tianyang ;
Gao, Shenghua ;
Liu, Jiang .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (10) :2281-2292
[10]   Accurate Screening of COVID-19 Using Attention-Based Deep 3D Multiple Instance Learning [J].
Han, Zhongyi ;
Wei, Benzheng ;
Hong, Yanfei ;
Li, Tianyang ;
Cong, Jinyu ;
Zhu, Xue ;
Wei, Haifeng ;
Zhang, Wei .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (08) :2584-2594