An explainable AI system for automated COVID-19 assessment and lesion categorization from CT-scans

被引:33
作者
Pennisi, Matteo [1 ]
Kavasidis, Isaak [1 ]
Spampinato, Concetto [1 ]
Schinina, Vincenzo [2 ]
Palazzo, Simone [1 ]
Salanitri, Federica Proietto [1 ]
Bellitto, Giovanni [1 ]
Rundo, Francesco [3 ]
Aldinucci, Marco [4 ]
Cristofaro, Massimo [2 ]
Campioni, Paolo [2 ]
Pianura, Elisa [2 ]
Di Stefano, Federica [2 ]
Petrone, Ada [2 ]
Albarello, Fabrizio [2 ]
Ippolito, Giuseppe [2 ]
Cuzzocrea, Salvatore [5 ]
Conoci, Sabrina [5 ]
机构
[1] Univ Catania, DIEEI, Catania, Italy
[2] Natl Inst Infect Dis, Lazzaro Spallanzani Dept, Rome, Italy
[3] STMicroelect ADG Cent R&D, Catania, Italy
[4] Univ Turin, Dept Comp Sci, Turin, Italy
[5] Univ Messina, ChimBioFaram Dept, Messina, Italy
基金
欧盟地平线“2020”;
关键词
COVID-19; detection; Lung segmentation; Deep learning; ARTIFICIAL-INTELLIGENCE; LUNG NODULES;
D O I
10.1016/j.artmed.2021.102114
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
COVID-19 infection caused by SARS-CoV-2 pathogen has been a catastrophic pandemic outbreak all over the world, with exponential increasing of confirmed cases and, unfortunately, deaths. In this work we propose an AI powered pipeline, based on the deep-learning paradigm, for automated COVID-19 detection and lesion categorization from CT scans. We first propose a new segmentation module aimed at automatically identifying lung parenchyma and lobes. Next, we combine the segmentation network with classification networks for COVID-19 identification and lesion categorization. We compare the model's classification results with those obtained by three expert radiologists on a dataset of 166 CT scans. Results showed a sensitivity of 90.3% and a specificity of 93.5% for COVID-19 detection, at least on par with those yielded by the expert radiologists, and an average lesion categorization accuracy of about 84%. Moreover, a significant role is played by prior lung and lobe segmentation, that allowed us to enhance classification performance by over 6 percent points. The interpretation of the trained AI models reveals that the most significant areas for supporting the decision on COVID-19 identification are consistent with the lesions clinically associated to the virus, i.e., crazy paving, consolidation and ground glass. This means that the artificial models are able to discriminate a positive patient from a negative one (both controls and patients with interstitial pneumonia tested negative to COVID) by evaluating the presence of those lesions into CT scans. Finally, the AI models are integrated into a user-friendly GUI to support AI explainability for radiologists, which is publicly available at http://perceivelab.com/covid-ai. The whole AI system is unique since, to the best of our knowledge, it is the first AI-based software, publicly available, that attempts to explain to radiologists what information is used by AI methods for making decisions and that proactively involves them in the decision loop to further improve the COVID-19 understanding.
引用
收藏
页数:12
相关论文
共 43 条
[1]  
Adebayo J, 2018, ADV NEUR IN, V31
[2]   On the Coronavirus (COVID-19) Outbreak and the Smart City Network: Universal Data Sharing Standards Coupled with Artificial Intelligence (AI) to Benefit Urban Health Monitoring and Management [J].
Allam, Zaheer ;
Jones, David S. .
HEALTHCARE, 2020, 8 (01)
[3]   The Lung Image Database Consortium, (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT Scans [J].
Armato, Samuel G., III ;
McLennan, Geoffrey ;
Bidaut, Luc ;
McNitt-Gray, Michael F. ;
Meyer, Charles R. ;
Reeves, Anthony P. ;
Zhao, Binsheng ;
Aberle, Denise R. ;
Henschke, Claudia I. ;
Hoffman, Eric A. ;
Kazerooni, Ella A. ;
MacMahon, Heber ;
van Beek, Edwin J. R. ;
Yankelevitz, David ;
Biancardi, Alberto M. ;
Bland, Peyton H. ;
Brown, Matthew S. ;
Engelmann, Roger M. ;
Laderach, Gary E. ;
Max, Daniel ;
Pais, Richard C. ;
Qing, David P-Y ;
Roberts, Rachael Y. ;
Smith, Amanda R. ;
Starkey, Adam ;
Batra, Poonam ;
Caligiuri, Philip ;
Farooqi, Ali ;
Gladish, Gregory W. ;
Jude, C. Matilda ;
Munden, Reginald F. ;
Petkovska, Iva ;
Quint, Leslie E. ;
Schwartz, Lawrence H. ;
Sundaram, Baskaran ;
Dodd, Lori E. ;
Fenimore, Charles ;
Gur, David ;
Petrick, Nicholas ;
Freymann, John ;
Kirby, Justin ;
Hughes, Brian ;
Casteele, Alessi Vande ;
Gupte, Sangeeta ;
Sallam, Maha ;
Heath, Michael D. ;
Kuhn, Michael H. ;
Dharaiya, Ekta ;
Burns, Richard ;
Fryd, David S. .
MEDICAL PHYSICS, 2011, 38 (02) :915-931
[4]   Artificial Intelligence Augmentation of Radiologist Performance in Distinguishing COVID-19 from Pneumonia of Other Origin at Chest CT [J].
Bai, Harrison X. ;
Wang, Robin ;
Xiong, Zeng ;
Hsieh, Ben ;
Chang, Ken ;
Halsey, Kasey ;
Thi My Linh Tran ;
Choi, Ji Whae ;
Wang, Dong-Cui ;
Shi, Lin-Bo ;
Mei, Ji ;
Jiang, Xiao-Long ;
Pan, Ian ;
Zeng, Qiu-Hua ;
Hu, Ping-Feng ;
Li, Yi-Hui ;
Fu, Fei-Xian ;
Huang, Raymond Y. ;
Sebro, Ronnie ;
Yu, Qi-Zhi ;
Atalay, Michael K. ;
Liao, Wei-Hua .
RADIOLOGY, 2020, 296 (03) :E156-E165
[5]  
Bai X., 2020, PREDICTING COVID 19, DOI [10.1101/2020.03.20.20037325, DOI 10.1101/2020.03.20.20037325]
[6]   Classification of Interstitial Lung Abnormality Patterns with an Ensemble of Deep Convolutional Neural Networks [J].
Bermejo-Pelaez, David ;
Ash, Samuel Y. ;
Washko, George R. ;
Jose Esteparz, Raul San ;
Ledesma-Carbayo, Maria J. .
SCIENTIFIC REPORTS, 2020, 10 (01)
[7]   Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays [J].
Brunese, Luca ;
Mercaldo, Francesco ;
Reginelli, Alfonso ;
Santone, Antonella .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 196
[8]   A new concordant partial AUC and partial c statistic for imbalanced data in the evaluation of machine learning algorithms [J].
Carrington, Andre M. ;
Fieguth, Paul W. ;
Qazi, Hammad ;
Holzinger, Andreas ;
Chen, Helen H. ;
Mayr, Franz ;
Manuel, Douglas G. .
BMC MEDICAL INFORMATICS AND DECISION MAKING, 2020, 20 (01)
[9]   Bladder Cancer Treatment Response Assessment in CT using Radiomics with Deep-Learning [J].
Cha, Kenny H. ;
Hadjiiski, Lubomir ;
Chan, Heang-Ping ;
Weizer, Alon Z. ;
Alva, Ajjai ;
Cohan, Richard H. ;
Caoili, Elaine M. ;
Paramagul, Chintana ;
Samala, Ravi K. .
SCIENTIFIC REPORTS, 2017, 7
[10]  
Chung MS, 2020, EUR RADIOL, V30, P2182, DOI [10.1148/radiol.2020200230, 10.1007/s00330-019-06574-1]