Stroke Treatment Prediction Using Features Selection Methods and Machine Learning Classifiers

被引:5
作者
Chourib, I. [1 ,2 ]
Guillard, G. [3 ]
Farah, I. R. [1 ]
Solaiman, B. [2 ]
机构
[1] Natl Sch Comp Sci, STICODE Dept, RIADI Lab, Manouba, Tunisia
[2] IMT Atlantique, MATHSTIC Dept, ITI Lab, Brest, France
[3] Intradys, Brest, France
关键词
Stroke disease; Feature selection; Data mining; Decision tree classifier; Naive Bayes; K-nearest neighbor; Recursive feature elimination; Tree-based model; Chi-square; CLASSIFICATION;
D O I
10.1016/j.irbm.2022.02.002
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objectives: Feature selection in data sets is an important task allowing to alleviate various machine learning and data mining issues. The main objectives of a feature selection method consist on building simpler and more understandable classifier models in order to improve the data mining and processing performances. Therefore, a comparative evaluation of the Chi-square method, recursive feature elimination method, and tree-based method (using Random Forest) used on the three common machine learning methods (K-Nearest Neighbor, naive Bayesian classifier and decision tree classifier) are performed to select the most relevant primitives from a large set of attributes. Furthermore, determining the most suitable couple (i.e., feature selection method-machine learning method) that provides the best performance is performed.Materials and methods: In this paper, an overview of the most common feature selection techniques is first provided: the Chi-Square method, the Recursive Feature Elimination method (RFE) and the tree-based method (using Random Forest). A comparative evaluation of the improvement (brought by such feature selection methods) to the three common machine learning methods (K-Nearest Neighbor, naive Bayesian classifier and decision tree classifier) are performed. For evaluation purposes, the following measures: micro-F1, accuracy and root mean square error are used on the stroke disease data set.Results: The obtained results show that the proposed approach (i.e., Tree Based Method using Random Forest, TBM-RF, decision tree classifier, DTC) provides accuracy higher than 85%, F1-score higher than 88%, thus, better than the KNN and NB using the Chi-Square, RFE and TBM-RF methods.Conclusion: This study shows that the couple -Tree Based Method using Random Forest (TBM-RF) decision tree classifier successfully and efficiently contributes to find the most relevant features and to predict and classify patient suffering of stroke disease."(c) 2022 AGBM. Published by Elsevier Masson SAS. All rights reserved.
引用
收藏
页码:678 / 686
页数:9
相关论文
共 40 条
[1]  
Abuaqel I, 2017, INF HLTH TECHN ICIHT, P1
[2]  
Aggrawal R, 2021, INT J PHARM SCI RES, V13
[3]   Experiments on the Use of Feature Selection and Machine Learning Methods in Automatic Malay Text Categorization [J].
Alshalabi, Hamood ;
Tiun, Sabrina ;
Omar, Nazlia ;
Albared, Mohammed .
4TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATICS (ICEEI 2013), 2013, 11 :748-754
[4]  
[Anonymous], 2001, ICML, DOI DOI 10.3233/IDA-1997-1302
[5]   Comparison of four SNR estimators for QPSK modulations [J].
Beaulieu, NC ;
Toms, AS ;
Pauluzzi, DR .
IEEE COMMUNICATIONS LETTERS, 2000, 4 (02) :43-45
[6]   Entropy [J].
Bein, Berthold .
BEST PRACTICE & RESEARCH-CLINICAL ANAESTHESIOLOGY, 2006, 20 (01) :101-109
[7]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[8]  
Daher M, 2015, I CON ADV BIOMED ENG, P93, DOI 10.1109/ICABME.2015.7323259
[9]   Overfitting and undercomputing in machine learning [J].
Dietterich, T .
ACM COMPUTING SURVEYS, 1995, 27 (03) :326-327
[10]   Support vector machine classification and validation of cancer tissue samples using microarray expression data [J].
Furey, TS ;
Cristianini, N ;
Duffy, N ;
Bednarski, DW ;
Schummer, M ;
Haussler, D .
BIOINFORMATICS, 2000, 16 (10) :906-914