A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and COVID-19 pneumonia from chest X-ray images

被引:102
作者
Wang, Guangyu [1 ]
Liu, Xiaohong [2 ,3 ]
Shen, Jun [4 ]
Wang, Chengdi [5 ]
Li, Zhihuan [6 ,7 ]
Ye, Linsen [8 ,9 ]
Wu, Xingwang [10 ]
Chen, Ting [2 ,3 ]
Wang, Kai [2 ,3 ]
Zhang, Xuan [2 ,3 ]
Zhou, Zhongguo [11 ]
Yang, Jian [12 ]
Sang, Ye [12 ]
Deng, Ruiyun [13 ]
Liang, Wenhua [14 ,15 ]
Yu, Tao [4 ]
Gao, Ming [4 ]
Wang, Jin [8 ,9 ]
Yang, Zehong [4 ]
Cai, Huimin [13 ]
Lu, Guangming [16 ]
Zhang, Lingyan [17 ]
Yang, Lei [18 ]
Xu, Wenqin [6 ,7 ]
Wang, Winston [6 ,7 ]
Olevera, Andrea [6 ,7 ]
Ziyar, Ian [6 ,7 ]
Zhang, Charlotte [13 ]
Li, Oulan [13 ]
Liao, Weihua [19 ,20 ]
Liu, Jun [21 ]
Chen, Wen [22 ]
Chen, Wei [23 ,24 ]
Shi, Jichan [25 ]
Zheng, Lianghong [6 ,7 ]
Zhang, Longjiang [16 ]
Yan, Zhihan [23 ,24 ]
Zou, Xiaoguang [26 ]
Lin, Guiping [4 ]
Cao, Guiqun [5 ]
Lau, Laurance L. [6 ,7 ]
Mo, Long [19 ,20 ]
Liang, Yong [6 ,7 ]
Roberts, Michael [27 ,28 ]
Sala, Evis [29 ,30 ]
Schonlieb, Carola-Bibiane [28 ]
Fok, Manson [6 ,7 ]
Lau, Johnson Yiu-Nam [31 ]
Xu, Tao [13 ]
He, Jianxing [14 ,15 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing, Peoples R China
[3] Tsinghua Univ, BNRist, Beijing, Peoples R China
[4] Sun Yat Sen Univ, Sun Yat Sen Mem Hosp, Dept Urol, Dept Radiol,Dept Emergency Med,Dept Disciplinary, Guangzhou, Peoples R China
[5] Sichuan Univ, West China Hosp, Frontiers Sci Ctr Dis Related Mol Network,West Ch, Ctr Translat Med & Innovat,Dept Resp & Crit Care, Chengdu, Peoples R China
[6] Macau Univ Sci & Technol, Fac Med, Ctr Biomed & Innovat, Macau, Peoples R China
[7] Univ Hosp, Macau, Peoples R China
[8] Sun Yat Sen Univ, Affiliated Hosp 3, Dept Hepat Surg, Guangzhou, Peoples R China
[9] Sun Yat Sen Univ, Affiliated Hosp 3, Liver Transplantat Ctr, Guangzhou, Peoples R China
[10] Anhui Med Univ, Dept Radiol, Affiliated Hosp 1, Hefei, Peoples R China
[11] Sun Yat Sen Univ, Sun Yat Sen Canc Ctr, Guangzhou, Peoples R China
[12] China Three Gorges Univ, Coll Clin Med Sci 1, Yichang, Peoples R China
[13] Bioland Lab, Dept Bioinformat, Guangzhou Regenerat Med & Hlth Guangdong Lab, Guangzhou, Peoples R China
[14] Guangzhou Med Univ, Affiliated Hosp 1, Dept Thorac Surg & Oncol, China State Key Lab, Guangzhou, Peoples R China
[15] Natl Clin Res Ctr Resp Dis, Guangzhou, Peoples R China
[16] Nanjing Univ, Jinling Hosp, Dept Med Imaging, Med Sch, Nanjing, Peoples R China
[17] Southern Med Univ, Affiliated Hosp 3, Dept Med Imaging, Guangzhou, Peoples R China
[18] Sun Yat Sen Univ, Dept Thorac Surg, Affiliated Hosp 1, Guangzhou, Peoples R China
[19] Cent South Univ, Xiangya Hosp, Dept Med Imaging, Changsha, Peoples R China
[20] Cent South Univ, Xiangya Hosp, Dept Cardiol, Changsha, Peoples R China
[21] Cent South Univ, Xiangya Hosp 2, Dept Radiol, Changsha, Peoples R China
[22] Hubei Univ Med, Taihe Hosp, Dept Radiol, Shiyan, Hubei, Peoples R China
[23] Wenzhou Med Univ, Dept Radiol, Affiliated Hosp 2, Wenzhou, Peoples R China
[24] Wenzhou Med Univ, Yuying Childrens Hosp, Wenzhou, Peoples R China
[25] Wenzhou Cent Hosp, Dept Infect Dis, Wenzhou, Peoples R China
[26] First Peoples Hosp Kashi Prefecture, Dept Resp & Crit Care Med, Kashi, Peoples R China
[27] AstraZeneca, Oncol R&D, Cambridge, England
[28] Univ Cambridge, Dept Appl Math & Theoret Phys, Cambridge, England
[29] Univ Cambridge, Dept Radiol, Cambridge, England
[30] Univ Cambridge, Canc Res UK Cambridge Ctr, Cambridge, England
[31] Hong Kong Polytech Univ, Dept Appl Biol & Chem Technol, Hong Kong, Peoples R China
基金
英国工程与自然科学研究理事会; 中国国家自然科学基金;
关键词
MEDICAL IMAGING DATA; AI SYSTEM; RADIOGRAPHS; DATABASE;
D O I
10.1038/s41551-021-00704-1
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
An automated deep-learning pipeline for chest-X-ray-image standardization, lesion visualization and disease diagnosis can identify viral pneumonia caused by COVID-19, assess its severity, and discriminate it from other types of pneumonia. Common lung diseases are first diagnosed using chest X-rays. Here, we show that a fully automated deep-learning pipeline for the standardization of chest X-ray images, for the visualization of lesions and for disease diagnosis can identify viral pneumonia caused by coronavirus disease 2019 (COVID-19) and assess its severity, and can also discriminate between viral pneumonia caused by COVID-19 and other types of pneumonia. The deep-learning system was developed using a heterogeneous multicentre dataset of 145,202 images, and tested retrospectively and prospectively with thousands of additional images across four patient cohorts and multiple countries. The system generalized across settings, discriminating between viral pneumonia, other types of pneumonia and the absence of disease with areas under the receiver operating characteristic curve (AUCs) of 0.94-0.98; between severe and non-severe COVID-19 with an AUC of 0.87; and between COVID-19 pneumonia and other viral or non-viral pneumonia with AUCs of 0.87-0.97. In an independent set of 440 chest X-rays, the system performed comparably to senior radiologists and improved the performance of junior radiologists. Automated deep-learning systems for the assessment of pneumonia could facilitate early intervention and provide support for clinical decision-making.
引用
收藏
页码:509 / +
页数:16
相关论文
共 36 条
  • [1] Use of Chest Imaging in the Diagnosis and Management of COVID-19: A WHO Rapid Advice Guide
    Akl, Elie A.
    Blazic, Ivana
    Yaacoub, Sally
    Frija, Guy
    Chou, Roger
    Appiah, John Adabie
    Fatehi, Mansoor
    Flor, Nicola
    Hitti, Eveline
    Jafri, Hussain
    Jin, Zheng-Yu
    Kauczor, Hans Ulrich
    Kawooya, Michael
    Kazerooni, Ella Annabelle
    Ko, Jane P.
    Mahfouz, Rami
    Muglia, Valdair
    Nyabanda, Rose
    Sanchez, Marcelo
    Shete, Priya B.
    Ulla, Marina
    Zheng, Chuansheng
    van Deventer, Emilie
    Perez, Maria del Rosario
    [J]. RADIOLOGY, 2021, 298 (02) : E63 - E69
  • [2] STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
    BLAND, JM
    ALTMAN, DG
    [J]. LANCET, 1986, 1 (8476) : 307 - 310
  • [3] A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster
    Chan, Jasper Fuk-Woo
    Yuan, Shuofeng
    Kok, Kin-Hang
    To, Kelvin Kai-Wang
    Chu, Hin
    Yang, Jin
    Xing, Fanfan
    Liu, Jieling
    Yip, Cyril Chik-Yan
    Poon, Rosana Wing-Shan
    Tsoi, Hoi-Wah
    Lo, Simon Kam-Fai
    Chan, Kwok-Hung
    Poon, Vincent Kwok-Man
    Chan, Wan-Mui
    Ip, Jonathan Daniel
    Cai, Jian-Piao
    Cheng, Vincent Chi-Chung
    Chen, Honglin
    Hui, Christopher Kim-Ming
    Yuen, Kwok-Yung
    [J]. LANCET, 2020, 395 (10223) : 514 - 523
  • [4] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [5] Cohen John, 2020, SCIENCE, DOI [10.1126/science.abb1256, DOI 10.1126/SCIENCE.ABB0611, 10.1126/science.abb0611.]
  • [6] 1977 RIETZ LECTURE - BOOTSTRAP METHODS - ANOTHER LOOK AT THE JACKKNIFE
    EFRON, B
    [J]. ANNALS OF STATISTICS, 1979, 7 (01) : 1 - 26
  • [7] A guide to deep learning in healthcare
    Esteva, Andre
    Robicquet, Alexandre
    Ramsundar, Bharath
    Kuleshov, Volodymyr
    DePristo, Mark
    Chou, Katherine
    Cui, Claire
    Corrado, Greg
    Thrun, Sebastian
    Dean, Jeff
    [J]. NATURE MEDICINE, 2019, 25 (01) : 24 - 29
  • [8] Imaging of pneumonia: trends and algorithms
    Franquet, T
    [J]. EUROPEAN RESPIRATORY JOURNAL, 2001, 18 (01) : 196 - 208
  • [9] Ghesu F. C., 2016, INT C MED IM COMP CO, P229, DOI DOI 10.1007/978-3-319-46726-9_27
  • [10] Interleukin-6 Receptor Antagonists in Critically Ill Patients with Covid-19
    Gordon, Anthony C.
    Al-Beidh, Farah
    Rowan, Kathryn M.
    Nichol, Alistair D.
    Arabi, Yaseen M.
    Annane, Djillali
    Beane, Ahi
    Van Bentum-Puijk, Wilma
    Berry, Lindsay R.
    Bhimani, Zahra
    Bonten, Marc J. M.
    Bradbury, Charlotte A.
    Brunkhorst, Frank M.
    Buzgau, Adrian
    Cheng, Allen C.
    Detry, Michelle A.
    Duffy, Eamon J.
    Estcourt, Lise J.
    Fitzgerald, Mark
    Goossens, Herman
    Haniffa, Rashan
    Higgins, Alisa M.
    Hills, Thomas E.
    Horvat, Christopher M.
    Lamontagne, Francois
    Lawler, Patrick R.
    Leavis, Helen L.
    Linstrum, Kelsey M.
    Litton, Edward
    Lorenzi, Elizabeth
    Marshall, John C.
    Mayr, Florian B.
    McAuley, Daniel F.
    McGlothlin, Anna
    McGuinness, Shay P.
    McVerry, Bryan J.
    Montgomery, Stephanie K.
    Morpeth, Susan C.
    Murthy, Srinivas
    Orr, Katrina
    Parke, Rachael L.
    Parker, Jane C.
    Patanwala, Asad E.
    Pettill, Ville
    Rademaker, Emma
    Santos, Marlene S.
    Saunders, Christina T.
    Seymour, Christopher W.
    Shankar-Hari, Manu
    Sligl, Wendy L.
    [J]. NEW ENGLAND JOURNAL OF MEDICINE, 2021, 384 (16) : 1491 - 1502