Support Vector Machines (SVMs) versus Multilayer Perception (MLP) in data classification

被引:114
作者
Zanaty, E. A. [1 ]
机构
[1] Sohag Univ, Fac Sci, Math Dept, Comp Sci Sect, Sohag, Egypt
关键词
Neural networks; Support vector machine; Kernel functions; Quadratic Programming (QP);
D O I
10.1016/j.eij.2012.08.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we introduce a new kernel function for improving the accuracy of the Support Vector Machines (SVMs) classification. The proposed kernel function is stated in general form and is called Gaussian Radial Basis Polynomials Function (GRPF) that combines both Gaussian Radial Basis Function (RBF) and Polynomial (POLY) kernels. We implement the proposed kernel with a number of parameters associated with the use of the SVM algorithm that can impact the results. A comparative analysis of SVMs versus the Multilayer Perception (MLP) for data classifications is also presented to verify the effectiveness of the proposed kernel function. We seek an answer to the question: "which kernel can achieve a high accuracy classification versus multi-layer neural networks''. The support vector machines are evaluated in comparisons with different kernel functions and multi-layer neural networks by application to a variety of nonseparable data sets with several attributes. It is shown that the proposed kernel gives good classification accuracy in nearly all the data sets, especially those of high dimensions. The use of the proposed kernel results in a better, performance than those with existing kernels. (C) 2012 Faculty of Computers and Information, Cairo University. Production and hosting by Elsevier B.V. All rights reserved.
引用
收藏
页码:177 / 183
页数:7
相关论文
共 40 条
[1]  
Afifi A, 2009, INT J INTELL COMPUTE, V1, P55
[2]  
[Anonymous], NIPS
[3]  
Bakir GH, 2004, ADV NEUR IN, V16, P449
[4]  
Baudat G, 2001, IEEE IJCNN, P1244, DOI 10.1109/IJCNN.2001.939539
[5]   Gradient-based optimization of hyperparameters [J].
Bengio, Y .
NEURAL COMPUTATION, 2000, 12 (08) :1889-1900
[6]  
Boser B. E., 1992, Proceedings of the Fifth Annual ACM Workshop on Computational Learning Theory, P144, DOI 10.1145/130385.130401
[7]  
Burges CJ, 1997, NEUR INFORM P SYST, V9, P375
[8]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[9]   Choosing multiple parameters for support vector machines [J].
Chapelle, O ;
Vapnik, V ;
Bousquet, O ;
Mukherjee, S .
MACHINE LEARNING, 2002, 46 (1-3) :131-159
[10]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297