DenResCov-19: A deep transfer learning network for robust automatic classification of COVID-19, pneumonia, and tuberculosis from X-rays

被引:42
作者
Mamalakis, Michail [1 ,2 ]
Swift, Andrew J. [2 ,3 ]
Vorselaars, Bart [4 ]
Ray, Surajit [5 ]
Weeks, Simonne [6 ]
Ding, Weiping [7 ]
Clayton, Richard H. [1 ,2 ]
Mackenzie, Louise S. [6 ]
Banerjee, Abhirup [8 ,9 ]
机构
[1] Univ Sheffield, Dept Comp Sci, Sheffield, S Yorkshire, England
[2] Insigneo Inst In Silico Med, Sheffield, S Yorkshire, England
[3] Univ Sheffield, Dept Infect Immun & Cardiovasc Dis, Sheffield, S Yorkshire, England
[4] Univ Lincoln, Sch Math & Phys, Lincoln LN6 7TS, England
[5] Univ Glasgow, Sch Math & Stat, Glasgow G12 8QW, Lanark, Scotland
[6] Univ Brighton, Sch Appl Sci, Brighton BN2 4GJ, E Sussex, England
[7] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
[8] Univ Oxford, Radcliffe Dept Med, Div Cardiovasc Med, Oxford OX3 9DU, England
[9] Univ Oxford, Inst Biomed Engn, Dept Engn Sci, Oxford OX3 7DQ, England
基金
中国国家自然科学基金; 英国惠康基金; 英国工程与自然科学研究理事会;
关键词
COVID-19; Pneumonia; Chest X-rays; Deep transfer learning network; Automatic classification; Tuberculosis;
D O I
10.1016/j.compmedimag.2021.102008
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The global pandemic of coronavirus disease 2019 (COVID-19) is continuing to have a significant effect on the well-being of the global population, thus increasing the demand for rapid testing, diagnosis, and treatment. As COVID-19 can cause severe pneumonia, early diagnosis is essential for correct treatment, as well as to reduce the stress on the healthcare system. Along with COVID-19, other etiologies of pneumonia and Tuberculosis (TB) constitute additional challenges to the medical system. Pneumonia (viral as well as bacterial) kills about 2 million infants every year and is consistently estimated as one of the most important factor of childhood mortality (according to the World Health Organization). Chest X-ray (CXR) and computed tomography (CT) scans are the primary imaging modalities for diagnosing respiratory diseases. Although CT scans are the gold standard, they are more expensive, time consuming, and are associated with a small but significant dose of radiation. Hence, CXR have become more widespread as a first line investigation. In this regard, the objective of this work is to develop a new deep transfer learning pipeline, named DenResCov-19, to diagnose patients with COVID-19, pneumonia, TB or healthy based on CXR images. The pipeline consists of the existing DenseNet-121 and the ResNet-50 networks. Since the DenseNet and ResNet have orthogonal performances in some instances, in the proposed model we have created an extra layer with convolutional neural network (CNN) blocks to join these two models together to establish superior performance as compared to the two individual networks. This strategy can be applied universally in cases where two competing networks are observed. We have tested the performance of our proposed network on two-class (pneumonia and healthy), three-class (COVID-19 positive, healthy, and pneumonia), as well as four-class (COVID-19 positive, healthy, TB, and pneumonia) classification problems. We have validated that our proposed network has been able to successfully classify these lung-diseases on our four datasets and this is one of our novel findings. In particular, the AUC-ROC are 99.60, 96.51, 93.70, 96.40% and the F1 values are 98.21, 87.29, 76.09, 83.17% on our Dataset X-Ray 1, 2, 3, and 4 (DXR1, DXR2, DXR3, DXR4), respectively.
引用
收藏
页数:13
相关论文
共 63 条
[1]  
[Anonymous], 2017, IEEE INT C COMPUT VI, DOI [10.1109/iccv.201, DOI 10.1109/ICCV.2017.322]
[2]   Use of Machine Learning and Artificial Intelligence to predict SARS-CoV-2 infection from Full Blood Counts in a population [J].
Banerjee, Abhirup ;
Ray, Surajit ;
Vorselaars, Bart ;
Kitson, Joanne ;
Mamalakis, Michail ;
Weeks, Simonne ;
Baker, Mark ;
Mackenzie, Louise S. .
INTERNATIONAL IMMUNOPHARMACOLOGY, 2020, 86
[3]  
Bharati Subrato, 2020, Inform Med Unlocked, V20, P100391, DOI 10.1016/j.imu.2020.100391
[4]   Comparing different deep learning architectures for classification of chest radiographs [J].
Bressem, Keno K. ;
Adams, Lisa C. ;
Erxleben, Christoph ;
Hamm, Bernd ;
Niehues, Stefan M. ;
Vahldiek, Janis L. .
SCIENTIFIC REPORTS, 2020, 10 (01)
[5]   PadChest: A large chest x-ray image dataset with multi-label annotated reports [J].
Bustos, Aurelia ;
Pertusa, Antonio ;
Salinas, Jose-Maria ;
de la Iglesia-Vaya, Maria .
MEDICAL IMAGE ANALYSIS, 2020, 66
[6]   AI-driven quantification, staging and outcome prediction of COVID-19 pneumonia [J].
Chassagnon, Guillaume ;
Vakalopoulou, Maria ;
Battistella, Enzo ;
Christodoulidis, Stergios ;
Trieu-Nghi Hoang-Thi ;
Dangeard, Severine ;
Deutsch, Eric ;
Andre, Fabrice ;
Guillo, Enora ;
Halm, Nara ;
El Hajj, Stefany ;
Bompard, Florian ;
Neveu, Sophie ;
Hani, Chahinez ;
Saab, Ines ;
Campredon, Alienor ;
Koulakian, Hasmik ;
Bennani, Souhail ;
Freche, Gael ;
Barat, Maxime ;
Lombard, Aurelien ;
Fournier, Laure ;
Monnier, Hippolyte ;
Grand, Teodor ;
Gregory, Jules ;
Nguyen, Yann ;
Khalil, Antoine ;
Mahdjoub, Elyas ;
Brillet, Pierre-Yves ;
Ba, Stephane Tran ;
Bousson, Valerie ;
Mekki, Ahmed ;
Carlier, Robert-Yves ;
Revel, Marie-Pierre ;
Paragios, Nikos .
MEDICAL IMAGE ANALYSIS, 2021, 67
[7]   Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography [J].
Chen, Jun ;
Wu, Lianlian ;
Zhang, Jun ;
Zhang, Liang ;
Gong, Dexin ;
Zhao, Yilin ;
Chen, Qiuxiang ;
Huang, Shulan ;
Yang, Ming ;
Yang, Xiao ;
Hu, Shan ;
Wang, Yonggui ;
Hu, Xiao ;
Zheng, Biqing ;
Zhang, Kuo ;
Wu, Huiling ;
Dong, Zehua ;
Xu, Youming ;
Zhu, Yijie ;
Chen, Xi ;
Zhang, Mengjiao ;
Yu, Lilei ;
Cheng, Fan ;
Yu, Honggang .
SCIENTIFIC REPORTS, 2020, 10 (01)
[8]   Diagnostic Testing for Severe Acute Respiratory Syndrome-Related Coronavirus 2 A Narrative Review [J].
Cheng, Matthew P. ;
Papenburg, Jesse ;
Desjardins, Michael ;
Kanjilal, Sanjat ;
Quach, Caroline ;
Libman, Michael ;
Dittrich, Sabine ;
Yansouni, Cedric P. .
ANNALS OF INTERNAL MEDICINE, 2020, 172 (11) :726-+
[9]  
Cohen J. P., 2020, ARXIV200611988CSEESS, V1, P18272
[10]   Truncated inception net: COVID-19 outbreak screening using chest X-rays [J].
Das, Dipayan ;
Santosh, K. C. ;
Pal, Umapada .
PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2020, 43 (03) :915-925