Asymmetric least squares support vector machine classifiers

被引:46
作者
Huang, Xiaolin [1 ]
Shi, Lei [1 ,2 ]
Suykens, Johan A. K. [1 ]
机构
[1] Katholieke Univ Leuven, ESAT STADIUS, Dept Elect Engn, B-3001 Louvain, Belgium
[2] Fudan Univ, Sch Math Sci, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Classification; Support vector machine; Least squares support vector machine; Asymmetric least squares; ROBUSTNESS; RISK;
D O I
10.1016/j.csda.2013.09.015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In the field of classification, the support vector machine (SVM) pursues a large margin between two classes. The margin is usually measured by the minimal distance between two sets, which is related to the hinge loss or the squared hinge loss. However, the minimal value is sensitive to noise and unstable to re-sampling. To overcome this weak point, the expectile value is considered to measure the margin between classes instead of the minimal value. Motivated by the relation between the expectile value and the asymmetric squared loss, an asymmetric least squares SVM (aLS-SVM) is proposed. The proposed aLS-SVM can also be regarded as an extension to the LS-SVM and the L2-SVM. Theoretical analysis and numerical experiments on the aLS-SVM illustrate its insensitivity to noise around the boundary and its stability to re-sampling. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:395 / 405
页数:11
相关论文
共 37 条
[2]  
[Anonymous], LEARN THEORY
[3]  
Bi J., 2004, Advances in neural information processing systems, V17, P161
[4]  
Canu S., 2005, PERCEPTION SYSTEMS I
[5]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[6]  
Christmann A, 2004, J MACH LEARN RES, V5, P1007
[7]  
Christmann A., 2008, ADV NEURAL INF PROCE, P305
[8]  
De Brabanter J, 2002, LECT NOTES COMPUT SC, V2415, P713
[9]  
De Brabanter K, 2010, LS-SVMlab toolbox user's guide: version 1.7
[10]   Quantiles, expectiles and splines [J].
De Rossi, Giuliano ;
Harvey, Andrew .
JOURNAL OF ECONOMETRICS, 2009, 152 (02) :179-185