Multi-task driven explainable diagnosis of COVID-19 using chest X-ray images

被引:45
作者
Malhotra, Aakarsh [1 ]
Mittal, Surbhi [2 ]
Majumdar, Puspita [1 ]
Chhabra, Saheb [1 ]
Thakral, Kartik [2 ]
Vatsa, Mayank [2 ]
Singh, Richa [2 ]
Chaudhury, Santanu [2 ]
Pudrod, Ashwin [3 ]
Agrawal, Anjali [4 ]
机构
[1] IIT Delhi, New Delhi 110020, India
[2] IIT Jodhpur, Jodhpur 342037, Rajasthan, India
[3] Ashwini Hosp & Ramakant Heart Care Ctr, Nanded 431602, India
[4] TeleRadiol Solut, Bengaluru 560048, India
关键词
X-Ray; COVID-19; Detection; Diagnostics; Deep learning; Explainable artificial intelligence; Multi-task learning;
D O I
10.1016/j.patcog.2021.108243
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With increasing number of COVID-19 cases globally, all the countries are ramping up the testing numbers. While the RT-PCR kits are available in sufficient quantity in several countries, others are facing challenges with limited availability of testing kits and processing centers in remote areas. This has motivated researchers to find alternate methods of testing which are reliable, easily accessible and faster. Chest X-Ray is one of the modalities that is gaining acceptance as a screening modality. Towards this direction, the paper has two primary contributions. Firstly, we present the COVID-19 Multi-Task Network (COMiT-Net) which is an automated end-to-end network for COVID-19 screening. The proposed network not only predicts whether the CXR has COVID-19 features present or not, it also performs semantic segmentation of the regions of interest to make the model explainable. Secondly, with the help of medical professionals, we manually annotate the lung regions and semantic segmentation of COVID19 symptoms in CXRs taken from the ChestXray-14, CheXpert, and a consolidated COVID-19 dataset. These annotations will be released to the research community. Experiments performed with more than 2500 frontal CXR images show that at 90% specificity, the proposed COMiT-Net yields 96.80% sensitivity. (c) 2021 Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 44 条
[1]   COVID-CAPS: A capsule network-based framework for identification of COVID-19 cases from X-ray images [J].
Afshar, Parnian ;
Heidarian, Shahin ;
Naderkhani, Farnoosh ;
Oikonomou, Anastasia ;
Plataniotis, Konstantinos N. ;
Mohammadi, Arash .
PATTERN RECOGNITION LETTERS, 2020, 138 :638-643
[2]  
[Anonymous], 1995, P 3 INT C DOCUMENT A
[3]  
[Anonymous], 2017, IEEE INT C COMPUT VI, DOI [10.1109/iccv.201, DOI 10.1109/ICCV.2017.322]
[4]   Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks [J].
Apostolopoulos, Ioannis D. ;
Mpesiana, Tzani A. .
PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2020, 43 (02) :635-640
[5]   COVID-19 Deep Learning Prediction Model Using Publicly Available Radiologist-Adjudicated Chest X-Ray Images as Training Data: Preliminary Findings [J].
Azemin, Mohd Zulfaezal Che ;
Hassan, Radhiana ;
Tamrin, Mohd Izzuddin Mohd ;
Ali, Mohd Adli Md .
INTERNATIONAL JOURNAL OF BIOMEDICAL IMAGING, 2020, 2020
[6]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[7]  
Baraniuk R. G., 2020, ARXIV PREPRINT ARXIV
[8]  
BIMCV, 2020, BIMCV COVID19
[9]  
BSTI, COVID 19 BSTI IM DAT
[10]  
C. Imaging, 2020, COVID 19 CXR SPAIN