Optimal arrangements of hyperplanes for SVM-based multiclass classification

被引:23
作者
Blanco, Victor [1 ]
Japon, Alberto [2 ]
Puerto, Justo [2 ]
机构
[1] Univ Granada, IEMath GR, E-18001 Granada, Spain
[2] Univ Seville, IMUS, E-41012 Seville, Spain
关键词
Multiclass support vector machines; Mixed integer non linear programming; Classification; hyperplanes; SUPPORT VECTOR MACHINES; FEATURE-SELECTION; NEAREST-NEIGHBOR; PREDICTION;
D O I
10.1007/s11634-019-00367-6
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we present a novel SVM-based approach to construct multiclass classifiers by means of arrangements of hyperplanes. We propose different mixed integer (linear and non linear) programming formulations for the problem using extensions of widely used measures for misclassifying observations where the kernel trick can be adapted to be applicable. Some dimensionality reductions and variable fixing strategies are also developed for these models. An extensive battery of experiments has been run which reveal the powerfulness of our proposal as compared with other previously proposed methodologies.
引用
收藏
页码:175 / 199
页数:25
相关论文
共 40 条
[1]   Improving multiclass classification by deep networks using DAGSVM and Triplet Loss [J].
Agarwal, Nakul ;
Balasubramanian, Vineeth N. ;
Jawahar, C., V .
PATTERN RECOGNITION LETTERS, 2018, 112 :184-190
[2]   Reducing multiclass to binary: A unifying approach for margin classifiers [J].
Allwein, EL ;
Schapire, RE ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) :113-141
[3]  
[Anonymous], 2013, UCI MACHINE LEARNING
[4]  
[Anonymous], ARXIV181009167
[5]  
[Anonymous], ARXIV171110332
[6]  
[Anonymous], 2005, COMPUT MANAG SCI, DOI DOI 10.1007/s10287-004-0020-y
[7]   A novel piecewise linear classifier based on polyhedral conic and max-min separabilities [J].
Bagirov, Adil M. ;
Ugon, Julien ;
Webb, Dean ;
Ozturk, Gurkan ;
Kasimbeyli, Refail .
TOP, 2013, 21 (01) :3-24
[8]   On-line handwriting recognition with support vector machines - A kernel approach [J].
Bahlmann, C ;
Haasdonk, B ;
Burkhardt, H .
EIGHTH INTERNATIONAL WORKSHOP ON FRONTIERS IN HANDWRITING RECOGNITION: PROCEEDINGS, 2002, :49-54
[9]   On support vector machines under a multiple-cost scenario [J].
Benitez-Pena, Sandra ;
Blanquero, Rafael ;
Carrizosa, Emilio ;
Ramirez-Cobo, Pepa .
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2019, 13 (03) :663-682
[10]  
Bennett KP, 1999, ADV NEUR IN, V11, P368