Analyzing the effect of data preprocessing techniques using machine learning algorithms on the diagnosis of COVID-19

被引:5
作者
Erol, Gizemnur [1 ]
Uzbas, Betul [2 ]
Yucelbas, Cuneyt [3 ]
Yucelbas, Sule [4 ]
机构
[1] Konya Tech Univ, Software Engn Dept, Konya, Turkey
[2] Konya Tech Univ, Comp Engn Dept, Konya, Turkey
[3] Tarsus Univ, Mersin Tarsus OIZ Vocat Sch Tech Sci, Elect & Automat Dept, Mersin, Turkey
[4] Tarsus Univ, Comp Engn Dept, Mersin, Turkey
关键词
COVID-19; KNN imputation; machine learning; multivariate imputation by chained equation; synthetic minority oversampling technique;
D O I
10.1002/cpe.7393
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Real-time polymerase chain reaction (RT-PCR) known as the swab test is a diagnostic test that can diagnose COVID-19 disease through respiratory samples in the laboratory. Due to the rapid spread of the coronavirus around the world, the RT-PCR test has become insufficient to get fast results. For this reason, the need for diagnostic methods to fill this gap has arisen and machine learning studies have started in this area. On the other hand, studying medical data is a challenging area because the data it contains is inconsistent, incomplete, difficult to scale, and very large. Additionally, some poor clinical decisions, irrelevant parameters, and limited medical data adversely affect the accuracy of studies performed. Therefore, considering the availability of datasets containing COVID-19 blood parameters, which are less in number than other medical datasets today, it is aimed to improve these existing datasets. In this direction, to obtain more consistent results in COVID-19 machine learning studies, the effect of data preprocessing techniques on the classification of COVID-19 data was investigated in this study. In this study primarily, encoding categorical feature and feature scaling processes were applied to the dataset with 15 features that contain blood data of 279 patients, including gender and age information. Then, the missingness of the dataset was eliminated by using both K-nearest neighbor algorithm (KNN) and chain equations multiple value assignment (MICE) methods. Data balancing has been done with synthetic minority oversampling technique (SMOTE), which is a data balancing method. The effect of data preprocessing techniques on ensemble learning algorithms bagging, AdaBoost, random forest and on popular classifier algorithms KNN classifier, support vector machine, logistic regression, artificial neural network, and decision tree classifiers have been analyzed. The highest accuracies obtained with the bagging classifier were 83.42% and 83.74% with KNN and MICE imputations by applying SMOTE, respectively. On the other hand, the highest accuracy ratio reached with the same classifier without SMOTE was 83.91% for the KNN imputation. In conclusion, certain data preprocessing techniques are examined comparatively and the effect of these data preprocessing techniques on success is presented and the importance of the right combination of data preprocessing to achieve success has been demonstrated by experimental studies.
引用
收藏
页数:16
相关论文
共 43 条
[1]   Random forest method for the recognition of susceptibility and resistance patterns in antibiograms [J].
Ayala-Aldana, Nicolas ;
Gonzalez-Valdes, Leticia .
REVISTA CHILENA DE INFECTOLOGIA, 2023, 40 (01) :76-77
[2]  
Albayrak M., 2017, P 2017 MEDICAL TECHN, P242, DOI [10.1109/TIPTEKNO.2017.8238064, DOI 10.1109/TIPTEKNO.2017.8238064]
[3]  
AlJame Maryam, 2020, Inform Med Unlocked, V21, P100449, DOI 10.1016/j.imu.2020.100449
[4]  
Aljameel SS, 2021, SCI PROGRAMMING-NETH, V2021, DOI [10.1155/2021/5587188, 10.1155/2021/6494889]
[5]   Detection of COVID-19 in smartphone-based breathing recordings: A pre-screening deep learning tool [J].
Alkhodari, Mohanad ;
Khandoker, Ahsan H. .
PLOS ONE, 2022, 17 (01)
[6]   Impact of preprocessing on medical data classification [J].
Almuhaideb, Sarab ;
Menai, Mohamed El Bachir .
FRONTIERS OF COMPUTER SCIENCE, 2016, 10 (06) :1082-1102
[7]  
[Anonymous], HLTH TOP COR
[8]  
[Anonymous], WHO COVID-19 dashboard
[9]   Multiple imputation by chained equations: what is it and how does it work? [J].
Azur, Melissa J. ;
Stuart, Elizabeth A. ;
Frangakis, Constantine ;
Leaf, Philip J. .
INTERNATIONAL JOURNAL OF METHODS IN PSYCHIATRIC RESEARCH, 2011, 20 (01) :40-49
[10]   Detection of COVID-19 Infection from Routine Blood Exams with Machine Learning: A Feasibility Study [J].
Brinati, Davide ;
Campagner, Andrea ;
Ferrari, Davide ;
Locatelli, Massimo ;
Banfi, Giuseppe ;
Cabitza, Federico .
JOURNAL OF MEDICAL SYSTEMS, 2020, 44 (08)