Efficient sparse nonparallel support vector machines for classification

被引:28
作者
Tian, Yingjie [1 ]
Ju, Xuchan [2 ]
Qi, Zhiquan [1 ]
机构
[1] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Support vector machines; Twin support vector machines; Nonparallel; Structural risk minimization principle; Sparseness;
D O I
10.1007/s00521-012-1331-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel nonparallel classifier, named sparse nonparallel support vector machine (SNSVM), for binary classification. Different with the existing nonparallel classifiers, such as the twin support vector machines (TWSVMs), SNSVM has several advantages: It constructs two convex quadratic programming problems for both linear and nonlinear cases, which can be solved efficiently by successive overrelaxation technique; it does not need to compute the inverse matrices any more before training; it has the similar sparseness with standard SVMs; it degenerates to the TWSVMs when the parameters are appropriately chosen. Therefore, SNSVM is certainly superior to them theoretically. Experimental results on lots of data sets show the effectiveness of our method in both sparseness and classification accuracy and, therefore, confirm the above conclusions further.
引用
收藏
页码:1089 / 1099
页数:11
相关论文
共 25 条
[1]   Semisupervised Least Squares Support Vector Machine [J].
Adankon, Mathias M. ;
Cheriet, Mohamed ;
Biem, Alain .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (12) :1858-1870
[2]  
[Anonymous], PATTERN RECOGNIT
[3]  
[Anonymous], ADV KERNEL METHODS S
[4]  
[Anonymous], 1996, COMPUTATIONAL LEARNI
[5]  
Blake C. L., 1998, Uci repository of machine learning databases
[6]  
Borgwardt KM, 2011, SPR HBK COMPU STAT, P317, DOI 10.1007/978-3-642-16345-6_15
[7]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[8]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[9]   Text document preprocessing with the Bayes formula for classification using the Support Vector Machine [J].
Isa, Dino ;
Lee, Lam Hong ;
Kallimani, V. P. ;
RajKumar, R. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2008, 20 (09) :1264-1272
[10]  
Joachims T., 2000, International Conference on Machine Learning, P431