A second-order cone programming formulation for twin support vector machines

被引:26
作者
Maldonado, Sebastian [1 ]
Lopez, Julio [2 ]
Carrasco, Miguel [1 ]
机构
[1] Univ Los Andes, Fac Ingn & Ciencias Aplicadas, Santiago 12455, Chile
[2] Univ Diego Portales, Fac Ingn, Ejercito 441, Santiago, Chile
关键词
Support vector classification; Twin support vector machines; Second-order cone programming; CLASSIFICATION; OPTIMIZATION;
D O I
10.1007/s10489-016-0764-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Second-order cone programming (SOCP) formulations have received increasing attention as robust optimization schemes for Support Vector Machine (SVM) classification. These formulations study the worst-case setting for class-conditional densities, leading to potentially more effective classifiers in terms of performance compared to the standard SVM formulation. In this work we propose an SOCP extension for Twin SVM, a recently developed classification approach that constructs two nonparallel classifiers. The linear and kernel-based SOCP formulations for Twin SVM are derived, while the duality analysis provides interesting geometrical properties of the proposed method. Experiments on benchmark datasets demonstrate the virtues of our approach in terms of classification performance compared to alternative SVM methods.
引用
收藏
页码:265 / 276
页数:12
相关论文
共 34 条
[1]   Second-order cone programming [J].
Alizadeh, F ;
Goldfarb, D .
MATHEMATICAL PROGRAMMING, 2003, 95 (01) :3-51
[2]   Interior proximal algorithm with variable metric for second-order cone programming: applications to structural optimization and support vector machines [J].
Alvarez, Felipe ;
Lopez, Julio ;
Hector Ramirez, C. .
OPTIMIZATION METHODS & SOFTWARE, 2010, 25 (06) :859-881
[3]  
[Anonymous], P SIAM INT C DAT MIN
[4]  
Bache K., 2013, UCI Machine Learning Repository
[5]   A novel feature selection method for twin support vector machine [J].
Bai, Lan ;
Wang, Zhen ;
Shao, Yuan-Hai ;
Deng, Nai-Yang .
KNOWLEDGE-BASED SYSTEMS, 2014, 59 :1-8
[6]  
Bennett K. P., 2000, P ICML, P57
[7]   Support vector machine under uncertainty: An application for hydroacoustic classification of fish-schools in Chile [J].
Bosch, Paul ;
Lopez, Julio ;
Ramirez, Hector ;
Robotham, Hugo .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (10) :4029-4034
[8]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[9]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[10]   The Mahalanobis distance [J].
De Maesschalck, R ;
Jouan-Rimbaud, D ;
Massart, DL .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2000, 50 (01) :1-18