Multi-class second-order cone programming support vector machines

被引:23
作者
Lopez, Julio [1 ]
Maldonado, Sebastian [2 ]
机构
[1] Univ Diego Portales, Fac Ingn, Santiago, Chile
[2] Univ Los Andes, Fac Ingn & Ciencias Aplicadas, Santiago, Chile
关键词
Multi-class classification; Support vector machines; Second-order cone programming; Quadratic programming; Convex optimization; CLASSIFICATION; OPTIMIZATION; FORMULATIONS; SELECTION;
D O I
10.1016/j.ins.2015.10.016
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents novel second-order cone programming (SOCP) formulations that determine a linear multi-class predictor using support vector machines (SVMs). We first extend the ideas of OvO (One-versus-One) and OvA (One-versus-All) SVM formulations to SOCP-SVM, providing two interesting alternatives to the standard SVM formulations. Additionally, we propose a novel approach (MC-SOCP) that simultaneously constructs all required hyperplanes for multi-class classification, based on the multi-class SVM formulation (MC-SVM). The use of conic constraints for each pair of training patterns in a single optimization problem provides an adequate framework for a balanced and effective prediction. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:328 / 341
页数:14
相关论文
共 34 条
[1]   Second-order cone programming [J].
Alizadeh, F ;
Goldfarb, D .
MATHEMATICAL PROGRAMMING, 2003, 95 (01) :3-51
[2]   Interior proximal algorithm with variable metric for second-order cone programming: applications to structural optimization and support vector machines [J].
Alvarez, Felipe ;
Lopez, Julio ;
Hector Ramirez, C. .
OPTIMIZATION METHODS & SOFTWARE, 2010, 25 (06) :859-881
[3]  
[Anonymous], [No title captured]
[4]  
[Anonymous], P SIAM INT C DAT MIN
[5]  
Asuncion A., 2007, Uci machine learning repository
[6]   Support vector machine under uncertainty: An application for hydroacoustic classification of fish-schools in Chile [J].
Bosch, Paul ;
Lopez, Julio ;
Ramirez, Hector ;
Robotham, Hugo .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (10) :4029-4034
[7]  
BOTTOU L, 1994, INT C PATT RECOG, P77, DOI 10.1109/ICPR.1994.576879
[8]  
Bravo C., 2014, Journal of the Operational Research Society, V66, P771
[9]   Multicategory classification by support vector machines [J].
Bredensteiner, EJ ;
Bennett, KP .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1999, 12 (1-3) :53-79
[10]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)