Twin Mahalanobis distance-based support vector machines for pattern recognition

被引:39
作者
Peng, Xinjun [1 ]
Xu, Dong
机构
[1] Shanghai Normal Univ, Dept Math, Shanghai 200234, Peoples R China
关键词
Mahalanobis distance; Covariance matrix; Reproducing kernel Hilbert space; Support vector machine; Nonparallel hyperplanes; KERNELIZATION FRAMEWORK; CLASSIFICATION; CLASSIFIERS;
D O I
10.1016/j.ins.2012.02.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twin support vector machines (TSVMs) achieve fast training speed and good performance for data classification. However, TSVMs do not take full advantage of the statistical information in data, such as the covariance of each class of data. This paper proposes a new twin Mahalanobis distance-based support vector machine (TMSVM) classifier, in which two Mahalanobis distance-based kernels are constructed according to the covariance matrices of two classes of data for optimizing the nonparallel hyperplanes. TMSVMs have a special case of TSVMs when the covariance matrices in a reproducing kernel Hilbert space are degenerated to the identity ones. TMSVMs are suitable for many real problems, especially for the case that the covariance matrices of two classes of data are obviously different. The experimental results on several artificial and benchmark datasets indicate that TMSVMs not only possess fast learning speed, but also obtain better generalization than TSVMs and other methods. Crown Copyright (C) 2012 Published by Elsevier Inc. All rights reserved.
引用
收藏
页码:22 / 37
页数:16
相关论文
共 39 条
[11]   Maxi-min margin machine: Learning large margin classifiers locally and globally [J].
Huang, Kaizhu ;
Yang, Haiqin ;
King, Irwin ;
Lyu, Michael R. .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (02) :260-272
[12]  
Huang KZ, 2004, J MACH LEARN RES, V5, P1253
[13]   Twin support vector machines for pattern classification [J].
Jayadeva ;
Khemchandani, R. ;
Chandra, Suresh .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (05) :905-910
[14]  
Joachims T., 1998, Machine Learning: ECML-98. 10th European Conference on Machine Learning. Proceedings, P137, DOI 10.1007/BFb0026683
[15]   Application of smoothing technique on twin support vector machines [J].
Kumar, M. Arun ;
Gopal, M. .
PATTERN RECOGNITION LETTERS, 2008, 29 (13) :1842-1848
[16]   Knowledge based Least Squares Twin support vector machines [J].
Kumar, M. Arun ;
Khemchandani, Reshma ;
Gopal, M. ;
Chandra, Suresh .
INFORMATION SCIENCES, 2010, 180 (23) :4606-4618
[17]   Least squares twin support vector machines for pattern classification [J].
Kumar, M. Arun ;
Gopal, M. .
EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (04) :7535-7543
[18]  
Lanckriet G. R. G., 2003, Journal of Machine Learning Research, V3, P555, DOI 10.1162/153244303321897726
[19]   Multisurface proximal support vector machine classification via generalized eigenvalues [J].
Mangasarian, OL ;
Wild, EW .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (01) :69-74
[20]  
Martinez A., 1998, The AR Face Database Technical Report 24