Study on transfer learning capabilities for pneumonia classification in chest-x-rays images

被引:30
作者
Avola, Danilo [1 ]
Bacciu, Andrea [1 ]
Cinque, Luigi [1 ]
Fagioli, Alessio [1 ]
Marini, Marco Raoul [1 ]
Taiello, Riccardo [1 ]
机构
[1] Sapienza Univ, Dept Comp Sci, Via Salaria 113, I-00185 Rome, Italy
基金
欧洲研究理事会;
关键词
Pneumonia classification; Deep learning; Transfer learning; Explainable Al; COVID-19; DETECTION; NETWORK;
D O I
10.1016/j.cmpb.2022.106833
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background: over the last year, the severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) and its variants have highlighted the importance of screening tools with high diagnostic accuracy for new illnesses such as COVID-19. In that regard, deep learning approaches have proven as effective solutions for pneumonia classification, especially when considering chest-x-rays images. However, this lung infection can also be caused by other viral, bacterial or fungi pathogens. Consequently, efforts are being poured toward distinguishing the infection source to help clinicians to diagnose the correct disease origin. Following this tendency, this study further explores the effectiveness of established neural network architectures on the pneumonia classification task through the transfer learning paradigm. Methodology: to present a comprehensive comparison, 12 well-known ImageNet pre-trained models were fine-tuned and used to discriminate among chest-x-rays of healthy people, and those showing pneumonia symptoms derived from either a viral (i.e., generic or SARS-CoV-2) or bacterial source. Furthermore, since a common public collection distinguishing between such categories is currently not available, two distinct datasets of chest-x-rays images, describing the aforementioned sources, were combined and employed to evaluate the various architectures. Results: the experiments were performed using a total of 6330 images split between train, validation, and test sets. For all models, standard classification metrics were computed (e.g., precision, fl-score), and most architectures obtained significant performances, reaching, among the others, up to 84.46% average fl-score when discriminating the four identified classes. Moreover, execution times, areas under the receiver operating characteristic (AUROC), confusion matrices, activation maps computed via the Grad-CAM algorithm, and additional experiments to assess the robustness of each model using only 50%, 20%, and 10% of the training set were also reported to present an informed discussion on the networks classifications. Conclusion: this paper examines the effectiveness of well-known architectures on a joint collection of chest-x-rays presenting pneumonia cases derived from either viral or bacterial sources, with particular attention to SARS-CoV-2 contagions for viral pathogens; demonstrating that existing architectures can effectively diagnose pneumonia sources and suggesting that the transfer learning paradigm could be a crucial asset in diagnosing future unknown illnesses. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 68 条
[1]   FSS-2019-nCov: A deep learning architecture for semi-supervised few-shot segmentation of COVID-19 infection [J].
Abdel-Basset, Mohamed ;
Chang, Victor ;
Hawash, Hossam ;
Chakrabortty, Ripon K. ;
Ryan, Michael .
KNOWLEDGE-BASED SYSTEMS, 2021, 212
[2]   Deep learning model for distinguishing novel coronavirus from other chest related infections in X-ray images [J].
Ahmad, Fareed ;
Khan, Muhammad Usman Ghani ;
Javed, Kashif .
COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 134
[3]   Coronavirus disease (COVID-19) detection using X-ray images and enhanced DenseNet [J].
Albahli, Saleh ;
Ayub, Nasir ;
Shiraz, Muhammad .
APPLIED SOFT COMPUTING, 2021, 110
[4]  
[Anonymous], 2014, COMPUT RES REPOSITOR
[5]  
[Anonymous], 2021, COMPUTER, V99, DOI [10.1016/j.asoc.2020.106906, DOI 10.1016/J.ASOC.2020.106906]
[6]   Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks [J].
Apostolopoulos, Ioannis D. ;
Mpesiana, Tzani A. .
PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2020, 43 (02) :635-640
[7]   CNN-based transfer learning-BiLSTM network: A novel approach for COVID-19 infection detection [J].
Aslan, Muhammet Fatih ;
Unlersen, Muhammed Fahri ;
Sabanci, Kadir ;
Durdu, Akif .
APPLIED SOFT COMPUTING, 2021, 98
[8]   Ultrasound Medical Imaging Techniques: A Survey [J].
Avola, Danilo ;
Cinque, Luigi ;
Fagioli, Alessio ;
Foresti, Gianluca ;
Mecca, Alessio .
ACM COMPUTING SURVEYS, 2022, 54 (03)
[9]   Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey [J].
Bhattacharya, Sweta ;
Maddikunta, Praveen Kumar Reddy ;
Pham, Quoc-Viet ;
Gadekallu, Thippa Reddy ;
Krishnan, S. Siva Rama ;
Chowdhary, Chiranji Lal ;
Alazab, Mamoun ;
Piran, Md. Jalil .
SUSTAINABLE CITIES AND SOCIETY, 2021, 65
[10]   Explainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays [J].
Brunese, Luca ;
Mercaldo, Francesco ;
Reginelli, Alfonso ;
Santone, Antonella .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 196