Mixed integer linear programming for feature selection in support vector machine

被引:32
作者
Labbe, Martine [1 ,2 ]
Martinez-Merino, Luisa I. [3 ]
Rodriguez-Chia, Antonio M. [3 ]
机构
[1] Univ Libre Bruxelles, Dept Informat, Brussels, Belgium
[2] INRIA Lille Nord Europe, INOCS, Lille, France
[3] Univ Cadiz, Dept Estadist & Invest Operat, Cadiz, Spain
关键词
Mathematical programming; Kernel search algorithm; Supervised classification; Support vector machine; Feature selection; KERNEL SEARCH; CLASSIFICATION; PREDICTION; CANCER;
D O I
10.1016/j.dam.2018.10.025
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This work focuses on support vector machine (SVM) with feature selection. A MILP formulation is proposed for the problem. The choice of suitable features to construct the separating hyperplanes has been modeled in this formulation by including a budget constraint that sets in advance a limit on the number of features to be used in the classification process. We propose both an exact and a heuristic procedure to solve this formulation in an efficient way. Finally, the validation of the model is done by checking it with some well-known data sets and comparing it with classical classification methods. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:276 / 304
页数:29
相关论文
共 22 条
[1]   Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays [J].
Alon, U ;
Barkai, N ;
Notterman, DA ;
Gish, K ;
Ybarra, S ;
Mack, D ;
Levine, AJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1999, 96 (12) :6745-6750
[2]   Kernel Search: a new heuristic framework for portfolio selection [J].
Angelelli, Enrico ;
Mansini, Renata ;
Speranza, M. Grazia .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2012, 51 (01) :345-361
[3]   Kernel search: A general heuristic for the multi-dimensional knapsack problem [J].
Angelelli, Enrico ;
Mansini, Renata ;
Speranza, M. Grazia .
COMPUTERS & OPERATIONS RESEARCH, 2010, 37 (11) :2017-2026
[4]  
[Anonymous], 2006, STUD FUZZINESS SOFT
[5]  
Asuncion A., 2007, UCI MACHINE LEARNING
[6]   Feature selection for support vector machines using Generalized Benders Decomposition [J].
Aytug, Haldun .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2015, 244 (01) :210-218
[7]   On handling indicator constraints in mixed integer programming [J].
Belotti, Pietro ;
Bonami, Pierre ;
Fischetti, Matteo ;
Lodi, Andrea ;
Monaci, Michele ;
Nogales-Gomez, Amaya ;
Salvagnin, Domenico .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2016, 65 (03) :545-566
[8]  
Bradley P. S., 1998, Machine Learning. Proceedings of the Fifteenth International Conference (ICML'98), P82
[9]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[10]   Binarized Support Vector Machines [J].
Carrizosa, Emilio ;
Martin-Barragan, Belen ;
Morales, Dolores Romero .
INFORMS JOURNAL ON COMPUTING, 2010, 22 (01) :154-167