Robust feature selection for multiclass Support Vector Machines using second-order cone programming

被引:4
作者
Lopez, Julio [1 ]
Maldonado, Sebastian [2 ]
机构
[1] Univ Diego Portales, Fac Ingn, Santiago, Chile
[2] Univ Los Andes, Santiago, Chile
关键词
Feature selection; multiclass classification; second-order cone programming; Support Vector Machines; GENE SELECTION; CLASSIFICATION; OPTIMIZATION; FORMULATIONS;
D O I
10.3233/IDA-150773
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work addresses the issue of high dimensionality for linear multiclass Support Vector Machines (SVMs) using second-order cone programming (SOCP) formulations. These formulations provide a robust and efficient framework for classification, while an adequate feature selection process may improve predictive performance. We extend the ideas of SOCP-SVM from binary to multiclass classification, while a sequential backward elimination algorithm is proposed for variable selection, defining a contribution measure to determine the feature relevance. Experimental results with multiclass microarray datasets demonstrate the effectiveness of a low-dimensional data representation in terms of performance.
引用
收藏
页码:S117 / S133
页数:17
相关论文
共 37 条
[1]   Second-order cone programming [J].
Alizadeh, F ;
Goldfarb, D .
MATHEMATICAL PROGRAMMING, 2003, 95 (01) :3-51
[2]   Interior proximal algorithm with variable metric for second-order cone programming: applications to structural optimization and support vector machines [J].
Alvarez, Felipe ;
Lopez, Julio ;
Hector Ramirez, C. .
OPTIMIZATION METHODS & SOFTWARE, 2010, 25 (06) :859-881
[3]   On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems [J].
Amaldi, E ;
Kann, V .
THEORETICAL COMPUTER SCIENCE, 1998, 209 (1-2) :237-260
[4]  
[Anonymous], P SIAM INT C DAT MIN
[5]  
[Anonymous], 1996, Technical Report, Statistics Department
[6]   MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia [J].
Armstrong, SA ;
Staunton, JE ;
Silverman, LB ;
Pieters, R ;
de Boer, ML ;
Minden, MD ;
Sallan, SE ;
Lander, ES ;
Golub, TR ;
Korsmeyer, SJ .
NATURE GENETICS, 2002, 30 (01) :41-47
[7]   Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses [J].
Bhattacharjee, A ;
Richards, WG ;
Staunton, J ;
Li, C ;
Monti, S ;
Vasa, P ;
Ladd, C ;
Beheshti, J ;
Bueno, R ;
Gillette, M ;
Loda, M ;
Weber, G ;
Mark, EJ ;
Lander, ES ;
Wong, W ;
Johnson, BE ;
Golub, TR ;
Sugarbaker, DJ ;
Meyerson, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2001, 98 (24) :13790-13795
[8]  
Bhattacharyya C, 2004, J MACH LEARN RES, V5, P1417
[9]   Support vector machine under uncertainty: An application for hydroacoustic classification of fish-schools in Chile [J].
Bosch, Paul ;
Lopez, Julio ;
Ramirez, Hector ;
Robotham, Hugo .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (10) :4029-4034
[10]  
BOTTOU L, 1994, INT C PATT RECOG, P77, DOI 10.1109/ICPR.1994.576879