Twin Mahalanobis distance-based support vector machines for pattern recognition

被引:39
作者
Peng, Xinjun [1 ]
Xu, Dong
机构
[1] Shanghai Normal Univ, Dept Math, Shanghai 200234, Peoples R China
关键词
Mahalanobis distance; Covariance matrix; Reproducing kernel Hilbert space; Support vector machine; Nonparallel hyperplanes; KERNELIZATION FRAMEWORK; CLASSIFICATION; CLASSIFIERS;
D O I
10.1016/j.ins.2012.02.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twin support vector machines (TSVMs) achieve fast training speed and good performance for data classification. However, TSVMs do not take full advantage of the statistical information in data, such as the covariance of each class of data. This paper proposes a new twin Mahalanobis distance-based support vector machine (TMSVM) classifier, in which two Mahalanobis distance-based kernels are constructed according to the covariance matrices of two classes of data for optimizing the nonparallel hyperplanes. TMSVMs have a special case of TSVMs when the covariance matrices in a reproducing kernel Hilbert space are degenerated to the identity ones. TMSVMs are suitable for many real problems, especially for the case that the covariance matrices of two classes of data are obviously different. The experimental results on several artificial and benchmark datasets indicate that TMSVMs not only possess fast learning speed, but also obtain better generalization than TSVMs and other methods. Crown Copyright (C) 2012 Published by Elsevier Inc. All rights reserved.
引用
收藏
页码:22 / 37
页数:16
相关论文
共 39 条
[1]  
[Anonymous], INTRO ALGORITHMS
[2]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[3]  
Breiman L., 1996, Tech. Rep. 460
[4]   A new kernelization framework for Mahalanobis distance learning algorithms [J].
Chatpatanasiri, Ratthachat ;
Korsrilabutr, Teesid ;
Tangchanachaianan, Pasakorn ;
Kijsirikul, Boonserm .
NEUROCOMPUTING, 2010, 73 (10-12) :1570-1579
[5]   A study on SMO-type decomposition methods for support vector machines [J].
Chen, Pai-Hsuen ;
Fan, Rong-En ;
Lin, Chih-Jen .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (04) :893-908
[6]   The Mahalanobis distance [J].
De Maesschalck, R ;
Jouan-Rimbaud, D ;
Massart, DL .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2000, 50 (01) :1-18
[7]   MAHALANOBIS KERNEL FOR THE CLASSIFICATION OF HYPERSPECTRAL IMAGES [J].
Fauvel, M. ;
Villa, A. ;
Chanussot, J. ;
Benediktsson, J. A. .
2010 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2010, :3724-3727
[8]   ROBUST ESTIMATES, RESIDUALS, AND OUTLIER DETECTION WITH MULTIRESPONSE DATA [J].
GNANADESIKAN, R ;
KETTENRING, JR .
BIOMETRICS, 1972, 28 (01) :81-+
[9]   Classification with Kernel Mahalanobis Distance Classifiers [J].
Haasdonk, Bernard ;
Pekalska, Elzbieta .
ADVANCES IN DATA ANALYSIS, DATA HANDLING AND BUSINESS INTELLIGENCE, 2010, :351-+
[10]   A comparison of methods for multiclass support vector machines [J].
Hsu, CW ;
Lin, CJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02) :415-425