COVID-19 detection and heatmap generation in chest x-ray images

被引:22
作者
Kusakunniran, Worapan [1 ]
Karnjanapreechakorn, Sarattha [1 ]
Siriapisith, Thanongchai [2 ]
Borwarnginn, Punyanuch [1 ]
Sutassananon, Krittanat [1 ]
Tongdee, Trongtum [2 ]
Saiviroonporn, Pairash [2 ]
机构
[1] Mahidol Univ, Fac Informat & Commun Technol, Phutthamonthon Dist, Nakhon Pathom, Thailand
[2] Mahidol Univ, Siriraj Hosp, Dept Radiol, Bangkok, Thailand
关键词
COVID-19; chest x-ray; heatmap; lung detection; ResNet; NETWORK;
D O I
10.1117/1.JMI.8.S1.014001
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: The outbreak of COVID-19 or coronavirus was first reported in 2019. It has widely and rapidly spread around the world. The detection of COVID-19 cases is one of the important factors to stop the epidemic, because the infected individuals must be quarantined. One reliable way to detect COVID-19 cases is using chest x-ray images, where signals of the infection are located in lung areas. We propose a solution to automatically classify COVID-19 cases in chest x-ray images. Approach: The ResNet-101 architecture is adopted as the main network with more than 44 millions parameters. The whole net is trained using the large size of 1500 x 1500 x-ray images. The heatmap under the region of interest of segmented lung is constructed to visualize and emphasize signals of COVID-19 in each input x-ray image. Lungs are segmented using the pretrained U-Net. The confidence score of being COVID-19 is also calculated for each classification result. Results: The proposed solution is evaluated based on COVID-19 and normal cases. It is also tested on unseen classes to validate a regularization of the constructed model. They include other normal cases where chest x-ray images are normal without any disease but with some small remarks, and other abnormal cases where chest x-ray images are abnormal with some other diseases containing remarks similar to COVID-19. The proposed method can achieve the sensitivity, specificity, and accuracy of 97%, 98%, and 98%, respectively. Conclusions: It can be concluded that the proposed solution can detect COVID-19 in a chest x-ray image. The heatmap and confidence score of the detection are also demonstrated, such that users or human experts can use them for a final diagnosis in practical usages. (C) The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License.
引用
收藏
页数:14
相关论文
共 28 条
[21]   COVID-19 infection: the perspectives on immune responses [J].
Shi, Yufang ;
Wang, Ying ;
Shao, Changshun ;
Huang, Jianan ;
Gan, Jianhe ;
Huang, Xiaoping ;
Bucci, Enrico ;
Piacentini, Mauro ;
Ippolito, Giuseppe ;
Melino, Gerry .
CELL DEATH AND DIFFERENTIATION, 2020, 27 (05) :1451-1454
[22]   Development of a digital image database for chest radiographs with and without a lung nodule: Receiver operating characteristic analysis of radiologists' detection of pulmonary nodules [J].
Shiraishi, J ;
Katsuragawa, S ;
Ikezoe, J ;
Matsumoto, T ;
Kobayashi, T ;
Komatsu, K ;
Matsui, M ;
Fujita, H ;
Kodera, Y ;
Doi, K .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2000, 174 (01) :71-74
[23]   Revisiting Unreasonable Effectiveness of Data in Deep Learning Era [J].
Sun, Chen ;
Shrivastava, Abhinav ;
Singh, Saurabh ;
Gupta, Abhinav .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :843-852
[24]   COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images [J].
Wang, Linda ;
Lin, Zhong Qiu ;
Wong, Alexander .
SCIENTIFIC REPORTS, 2020, 10 (01)
[25]   Spatiotemporal Pyramid Network for Video Action Recognition [J].
Wang, Yunbo ;
Long, Mingsheng ;
Wang, Jianmin ;
Yu, Philip S. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2097-2106
[26]   Multi-Level Feature Network With Multi-Loss for Person Re-Identification [J].
Wu, Huiyan ;
Xin, Ming ;
Fang, Wen ;
Hu, Hai-Miao ;
Hu, Zihao .
IEEE ACCESS, 2019, 7 :91052-91062
[27]   Wider or Deeper: Revisiting the ResNet Model for Visual Recognition [J].
Wu, Zifeng ;
Shen, Chunhua ;
van den Hengel, Anton .
PATTERN RECOGNITION, 2019, 90 :119-133
[28]   General-Purpose User Embeddings based on Mobile App Usage [J].
Zhang, Junqi ;
Bai, Bing ;
Lin, Ye ;
Liang, Jian ;
Bai, Kun ;
Wang, Fei .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :2831-2840