Automatic scoring of COVID-19 severity in X-ray imaging based on a novel deep learning workflow

被引:12
作者
Danilov, Viacheslav V. [1 ,2 ]
Litmanovich, Diana [3 ]
Proutski, Alex [1 ]
Kirpich, Alexander [4 ]
Nefaridze, Dato [1 ]
Karpovsky, Alex [5 ]
Gankin, Yuriy [1 ]
机构
[1] Quantori, Cambridge, MA 02142 USA
[2] Politecn Milan, Milan, Italy
[3] Beth Israel Deaconess Med Ctr, Boston, MA 02215 USA
[4] Georgia State Univ, Atlanta, GA 30303 USA
[5] Kanda Software, Newton, MA USA
关键词
D O I
10.1038/s41598-022-15013-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In this study, we propose a two-stage workflow used for the segmentation and scoring of lung diseases. The workflow inherits quantification, qualification, and visual assessment of lung diseases on X-ray images estimated by radiologists and clinicians. It requires the fulfillment of two core stages devoted to lung and disease segmentation as well as an additional post-processing stage devoted to scoring. The latter integrated block is utilized, mainly, for the estimation of segment scores and computes the overall severity score of a patient. The models of the proposed workflow were trained and tested on four publicly available X-ray datasets of COVID-19 patients and two X-ray datasets of patients with no pulmonary pathology. Based on a combined dataset consisting of 580 COVID-19 patients and 784 patients with no disorders, our best-performing algorithm is based on a combination of DeepLabV3 + , for lung segmentation, and MA-Net, for disease segmentation. The proposed algorithms' mean absolute error (MAE) of 0.30 is significantly reduced in comparison to established COVID-19 algorithms; BS-net and COVID-Net-S, possessing MAEs of 2.52 and 1.83 respectively. Moreover, the proposed two-stage workflow was not only more accurate but also computationally efficient, it was approximately 11 times faster than the mentioned methods. In summary, we proposed an accurate, time-efficient, and versatile approach for segmentation and scoring of lung diseases illustrated for COVID-19 and with broader future applications for pneumonia, tuberculosis, pneumothorax, amongst others.
引用
收藏
页数:22
相关论文
共 81 条
  • [71] COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images
    Wang, Linda
    Lin, Zhong Qiu
    Wong, Alexander
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [72] Spatiotemporal Pyramid Network for Video Action Recognition
    Wang, Yunbo
    Long, Mingsheng
    Wang, Jianmin
    Yu, Philip S.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2097 - 2106
  • [73] Severity scoring of lung oedema on the chest radiograph is associated with clinical outcomes in ARDS
    Warren, Melissa A.
    Zhao, Zhiguou
    Koyama, Tatsuki
    Bastarache, Julie A.
    Shaver, Ciara M.
    Semler, Matthew W.
    Rice, Todd W.
    Matthay, Michael A.
    Calfee, Carolyn S.
    Ware, Lorraine B.
    [J]. THORAX, 2018, 73 (09) : 840 - 846
  • [74] Towards computer-aided severity assessment via deep neural networks for geographic and opacity extent scoring of SARS-CoV-2 chest X-rays
    Wong, A.
    Lin, Z. Q.
    Wang, L.
    Chung, A. G.
    Shen, B.
    Abbasi, A.
    Hoshmand-Kochi, M.
    Duong, T. Q.
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [75] Frequency and Distribution of Chest Radiographic Findings in Patients Positive for COVID-19
    Wong, Ho Yuen Frank
    Lam, Hiu Yin Sonia
    Fong, Ambrose Ho-Tung
    Leung, Siu Ting
    Chin, Thomas Wing-Yan
    Lo, Christine Shing Yen
    Lui, Macy Mei-Sze
    Lee, Jonan Chun Yin
    Chiu, Keith Wan-Hang
    Chung, Tom Wai-Hin
    Lee, Elaine Yuen Phin
    Wan, Eric Yuk Fai
    Hung, Ivan Fan Ngai
    Lam, Tina Poy Wing
    Kuo, Michael D.
    Ng, Ming-Yen
    [J]. RADIOLOGY, 2020, 296 (02) : E72 - E78
  • [76] World Health Organization, Coronavirus disease (COVID-19) pandemic
  • [77] Risk factors for disease severity, unimprovement, and mortality in COVID-19 patients in Wuhan, China
    Zhang, J.
    Wang, X.
    Jia, X.
    Li, J.
    Hu, K.
    Chen, G.
    Wei, J.
    Gong, Z.
    Zhou, C.
    Yu, H.
    Yu, M.
    Lei, H.
    Cheng, F.
    Zhang, B.
    Xu, Y.
    Wang, G.
    Dong, W.
    [J]. CLINICAL MICROBIOLOGY AND INFECTION, 2020, 26 (06) : 767 - 772
  • [78] Pyramid Scene Parsing Network
    Zhao, Hengshuang
    Shi, Jianping
    Qi, Xiaojuan
    Wang, Xiaogang
    Jia, Jiaya
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6230 - 6239
  • [79] UNet plus plus : A Nested U-Net Architecture for Medical Image Segmentation
    Zhou, Zongwei
    Siddiquee, Md Mahfuzur Rahman
    Tajbakhsh, Nima
    Liang, Jianming
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 : 3 - 11
  • [80] Accuracy of the Radiographic Assessment of Lung Edema Score for the Diagnosis of ARDS
    Zimatore, Claudio
    Pisani, Luigi
    Lippolis, Valeria
    Warren, Melissa A.
    Calfee, Carolyn S.
    Ware, Lorraine B.
    Algera, Anna Geke
    Smit, Marry R.
    Grasso, Salvatore
    Schultz, Marcus J.
    [J]. FRONTIERS IN PHYSIOLOGY, 2021, 12