Comparing two SVM models through different metrics based on the confusion matrix

被引:93
作者
Valero-Carreras, Daniel [1 ]
Alcaraz, Javier [1 ]
Landete, Mercedes [1 ]
机构
[1] Univ Miguel Hernandez Elche, Inst Ctr Invest Operat, Dept Estadist Matemat & Informat, Elche, Spain
关键词
Support vector machine; Feature selection; Multi-objective optimization; Metaheuristics; MULTIOBJECTIVE GENETIC ALGORITHM; SUPPORT VECTOR MACHINES; FEATURE-SELECTION; OPTIMIZATION; PERFORMANCE;
D O I
10.1016/j.cor.2022.106131
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Support Vector Machines (SVM) are an efficient alternative for supervised classification. In the soft margin SVM model, two different objectives are optimized and the set of alternative solutions represent a Pareto-front of points, each one of them representing a different classifier. The performance of these classifiers can be evaluated and compared through some performance metrics that follow from the confusion matrix. Moreover, when the SVM includes feature selection, the model becomes hard to solve. In this paper, we present an alternative SVM model with feature selection and the performance of the new classifiers is compared to those of the classical soft margin model through some performance metrics based on the confusion matrix: the area under the ROC curve, Cohen's Kappa coefficient and the F-Score. Both the classical soft margin SVM model with feature selection and our proposal have been implemented by metaheuristics, given the complexity of the models to solve.
引用
收藏
页数:12
相关论文
共 45 条
[1]  
Abdunabi Tarek, 2014, 2014 IEEE International Conference on Big Data (Big Data), P10, DOI 10.1109/BigData.2014.7004386
[2]   A new hybrid approach for feature selection and support vector machine model selection based on self-adaptive cohort intelligence [J].
Aladeemy, Mohammed ;
Tutun, Salih ;
Khasawneh, Mohammad T. .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 88 :118-131
[3]   Support Vector Machine with feature selection: A multiobjective approach [J].
Alcaraz, Javier ;
Labbe, Martine ;
Landete, Mercedes .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 204
[4]   Metaphor-based metaheuristics, a call for action: the elephant in the room [J].
Aranha, Claus ;
Villalon, Christian L. Camacho ;
Campelo, Felipe ;
Dorigo, Marco ;
Ruiz, Ruben ;
Sevaux, Marc ;
Sorensen, Kenneth ;
Stutzle, Thomas .
SWARM INTELLIGENCE, 2022, 16 (01) :1-6
[5]   Feature selection for support vector machines using Generalized Benders Decomposition [J].
Aytug, Haldun .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2015, 244 (01) :210-218
[6]   Cost-sensitive Feature Selection for Support Vector Machines [J].
Benitez-Pena, S. ;
Blanquero, R. ;
Carrizosa, E. ;
Ramirez-Cobo, P. .
COMPUTERS & OPERATIONS RESEARCH, 2019, 106 :169-178
[7]   A multi-objective genetic algorithm for simultaneous model and feature selection for support vector machines [J].
Bouraoui, Amal ;
Jamoussi, Salma ;
BenAyed, Yassine .
ARTIFICIAL INTELLIGENCE REVIEW, 2018, 50 (02) :261-281
[8]  
Bradley P. S., 1998, Machine Learning. Proceedings of the Fifteenth International Conference (ICML'98), P82
[9]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[10]   Tuning hyperparameters of a SVM-based water demand forecasting system through parallel global optimization [J].
Candelieri, Antonio ;
Giordani, Ilaria ;
Archetti, Francesco ;
Barkalov, Konstantin ;
Meyerov, Iosif ;
Polovinkin, Alexey ;
Sysoyev, Alexander ;
Zolotykh, Nikolai .
COMPUTERS & OPERATIONS RESEARCH, 2019, 106 :202-209