Support vector machine classification with noisy data: a second order cone programming approach

被引:10
作者
Trafalis, Theodore B. [1 ]
Alwazzi, Samir A. [1 ]
机构
[1] Univ Oklahoma, Lab Optimizat & Intelligent Syst, Sch Ind Engn, Norman, OK 73019 USA
关键词
robust optimisation; kernel methods; support vector machines; semi definite programming; second order cone programming;
D O I
10.1080/03081079.2010.504340
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we investigate the stability of linear and quadratic programming support vector machines (SVMs) with bounded noise in the input data using a robust optimisation model. For a linear discriminant function, this model is expressed as a second order cone optimisation problem. Using the concept of the kernel function, we generalise for nonlinear discriminant functions. Intuitively, it looks quite clear that large margin classifiers are robust in terms of bounded input noise. However, there is no theoretical analysis investigating this behaviour. We show that the SVM solution is stable under bounded perturbations of the data both in the linear programming and quadratic programming. Computational results are also presented for toy and real-world data.
引用
收藏
页码:757 / 781
页数:25
相关论文
共 24 条
[1]   Robust convex optimization [J].
Ben-Tal, A ;
Nemirovski, A .
MATHEMATICS OF OPERATIONS RESEARCH, 1998, 23 (04) :769-805
[2]   Robust solutions of uncertain linear programs [J].
Ben-Tal, A ;
Nemirovski, A .
OPERATIONS RESEARCH LETTERS, 1999, 25 (01) :1-13
[3]  
Bennett K., 2000, SIGKDD EXPLORATIONS, V2, P1, DOI [10.1145/380995.380999, DOI 10.1145/380995.380999]
[5]   TRAINING WITH NOISE IS EQUIVALENT TO TIKHONOV REGULARIZATION [J].
BISHOP, CM .
NEURAL COMPUTATION, 1995, 7 (01) :108-116
[6]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[7]  
Christianini N., 2000, INTRO SUPPORT VECTOR, P189
[8]  
FUNG G, 2003, NEURAL INFORM PROCES, V15, P521
[9]  
GHAOUI LE, 2003, CSD031279 U CAL
[10]  
GHAOUI LE, 1997, SIAM J MATRIX ANAL A, V18, P1035, DOI DOI 10.1137/S0895479896298130