Robust minimum class variance twin support vector machine classifier

被引:17
作者
Peng, Xinjun [1 ,2 ]
Xu, Dong [1 ]
机构
[1] Shanghai Normal Univ, Dept Math, Shanghai 200234, Peoples R China
[2] Sci Comp Key Lab Shanghai Univ, Shanghai 200234, Peoples R China
关键词
Machine learning; Pattern recognition; Twin support vector machine; Nonparallel hyperplanes; Class variance matrices; PERFORMANCE; ALGORITHM;
D O I
10.1007/s00521-011-0791-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The recently proposed twin support vector machine (TWSVM) obtains much faster training speed and comparable performance than classical support vector machine. However, it only considers the empirical risk minimization principle, which leads to poor generalization for real-world applications. In this paper, we formulate a robust minimum class variance twin support vector machine (RMCV-TWSVM). RMCV-TWSVM effectively overcomes the shortcoming in TWSVM by introducing a pair of uncertain class variance matrices in its objective functions. As a special case, we present a special type of the uncertain class variance matrices by combining the empirical positive and negative class variance matrices. Computational results on several synthetic as well as benchmark datasets indicate the significant advantages of proposed classifier in both computational time and test accuracy.
引用
收藏
页码:999 / 1011
页数:13
相关论文
共 37 条
[1]  
[Anonymous], 1988, PITMAN RES NOTES MAT
[2]  
[Anonymous], 1990, STAT PATTERN RECOGNI
[3]  
[Anonymous], P KDD 2001 KNOWL DIS
[4]  
Blake C. L., 1998, Uci repository of machine learning databases
[5]   Knowledge-based analysis of microarray gene expression data by using support vector machines [J].
Brown, MPS ;
Grundy, WN ;
Lin, D ;
Cristianini, N ;
Sugnet, CW ;
Furey, TS ;
Ares, M ;
Haussler, D .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2000, 97 (01) :262-267
[6]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[7]   Newton's method for nonparallel plane proximal classifier with unity norm hyperplanes [J].
Ghorai, Santanu ;
Hossain, Shaikh Jahangir ;
Mukherjee, Anirban ;
Dutta, Pranab K. .
SIGNAL PROCESSING, 2010, 90 (01) :93-104
[8]   Nonparallel plane proximal classifier [J].
Ghorai, Santanu ;
Mukherjee, Anirban ;
Dutta, Pranab K. .
SIGNAL PROCESSING, 2009, 89 (04) :510-522
[9]   Twin support vector machines for pattern classification [J].
Jayadeva ;
Khemchandani, R. ;
Chandra, Suresh .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (05) :905-910
[10]  
Joachims T., 1998, Machine Learning: ECML-98. 10th European Conference on Machine Learning. Proceedings, P137, DOI 10.1007/BFb0026683