Sequential minimal optimization for SVM with pinball loss

被引:55
作者
Huang, Xiaolin [1 ]
Shi, Lei [2 ]
Suykens, Johan A. K. [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn, ESAT STADIUS, B-3001 Louvain, Belgium
[2] Fudan Univ, Sch Math Sci, Shanghai 200433, Peoples R China
基金
欧洲研究理事会; 中国国家自然科学基金;
关键词
Support vector machine; Pinball loss; Sequential minimal optimization; SMO ALGORITHM; SUPPORT; CONVERGENCE; CLASSIFIER;
D O I
10.1016/j.neucom.2014.08.033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To pursue the insensitivity to feature noise and the stability to re-sampling, a new type of support vector machine (SVM) has been established via replacing the hinge loss in the classical SVM by the pinball loss and was hence called a pin-SVM. Though a different loss function is used, pin-SVM has a similar structure as the classical SVM. Specifically, the dual problem of pin-SVM is a quadratic programming problem with box constraints, for which the sequential minimal optimization (SMO) technique is applicable. In this paper, we establish SMO algorithms for pin-SVM and its sparse version. The numerical experiments on real-life data sets illustrate both the good performance of pin-SVMs and the effectiveness of the established SMO methods. (C) 2014 Elsevier By. All rights reserved.
引用
收藏
页码:1596 / 1603
页数:8
相关论文
共 23 条
[1]  
Bi J., 2005, Adv. Neural Inf. Process. Syst., V17, P161
[2]  
Bottou L, 2007, LARGE SCALE KERNEL M, V3, P301, DOI DOI 10.7551/MITPRESS/7496.003.0003
[3]   The analysis of decomposition methods for support vector machines [J].
Chang, CC ;
Hsu, CW ;
Lin, CJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :1003-1008
[4]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[5]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[6]  
Fan RE, 2005, J MACH LEARN RES, V6, P1889
[7]  
Frank A., 2010, UCI machine learning repository, V213
[8]   Support Vector Machine Classifier with Pinball Loss [J].
Huang, Xiaolin ;
Shi, Lei ;
Suykens, Johan A. K. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (05) :984-997
[9]  
Hush D, 2006, J MACH LEARN RES, V7, P733
[10]   Convergence of a generalized SMO algorithm for SVM classifier design [J].
Keerthi, SS ;
Gilbert, EG .
MACHINE LEARNING, 2002, 46 (1-3) :351-360