Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning

被引:568
作者
Minaee, Shervin [1 ]
Kafieh, Rahele [2 ]
Sonka, Milan [3 ]
Yazdani, Shakib [4 ]
Soufi, Ghazaleh Jamalipour [5 ]
机构
[1] Snap Inc, Seattle, WA 98121 USA
[2] Isfahan Univ Med Sci, Med Image & Signal Proc Res Ctr, Esfahan, Iran
[3] Univ Iowa, Iowa Inst Biomed Imaging, Iowa City, IA USA
[4] Isfahan Univ Technol, ECE Dept, Esfahan, Iran
[5] Isfahan Univ Med Sci, Radiol Dept, Esfahan, Iran
关键词
COVID-19; X-ray imaging; Deep learning; Transfer learning; SOCIETY;
D O I
10.1016/j.media.2020.101794
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The COVID-19 pandemic is causing a major outbreak in more than 150 countries around the world, having a severe impact on the health and life of many people globally. One of the crucial step in fighting COVID-19 is the ability to detect the infected patients early enough, and put them under special care. Detecting this disease from radiography and radiology images is perhaps one of the fastest ways to diagnose the patients. Some of the early studies showed specific abnormalities in the chest radiograms of patients infected with COVID-19. Inspired by earlier works, we study the application of deep learning models to detect COVID-19 patients from their chest radiography images. We first prepare a dataset of 50 0 0 Chest X-rays from the publicly available datasets. Images exhibiting COVID-19 disease presence were identified by board-certified radiologist. Transfer learning on a subset of 20 0 0 radiograms was used to train four popular convolutional neural networks, including ResNet18, ResNet50, SqueezeNet, and DenseNet-121, to identify COVID-19 disease in the analyzed chest X-ray images. We evaluated these models on the remaining 30 0 0 images, and most of these networks achieved a sensitivity rate of 98% ( +/- 3%), while having a specificity rate of around 90%. Besides sensitivity and specificity rates, we also present the receiver operating characteristic (ROC) curve, precision-recall curve, average prediction, and confusion matrix of each model. We also used a technique to generate heatmaps of lung regions potentially infected by COVID-19 and show that the generated heatmaps contain most of the infected areas annotated by our board certified radiologist. While the achieved performance is very encouraging, further analysis is required on a larger set of COVID-19 images, to have a more reliable estimation of accuracy rates. The dataset, model implementations (in PyTorch), and evaluations, are all made publicly available for research community at https://github.com/shervinmin/DeepCovid.git (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 19 条
[1]   Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases [J].
Ai, Tao ;
Yang, Zhenlu ;
Hou, Hongyan ;
Zhan, Chenao ;
Chen, Chong ;
Lv, Wenzhi ;
Tao, Qian ;
Sun, Ziyong ;
Xia, Liming .
RADIOLOGY, 2020, 296 (02) :E32-E40
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]  
Cohen J.P., 2020, COVID-19 image data col- lection
[4]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[5]   Fleischner Society:: Glossary of terms tor thoracic imaging [J].
Hansell, David M. ;
Bankier, Alexander A. ;
MacMahon, Heber ;
McLoud, Theresa C. ;
Mueller, Nestor L. ;
Remy, Jacques .
RADIOLOGY, 2008, 246 (03) :697-722
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[8]  
Iandola F.N., 2016, SQUEEZENET ALEXNET L
[9]  
Irvin J, 2019, AAAI CONF ARTIF INTE, P590
[10]   Essentials for Radiologists on COVID-19: An Update-Radiology Scientific Expert Panel [J].
Kanne, Jeffrey P. ;
Little, Brent P. ;
Chung, Jonathan H. ;
Elicker, Brett M. ;
Ketai, Loren H. .
RADIOLOGY, 2020, 296 (02) :E113-E114