New Hermite orthogonal polynomial kernel and combined kernels in Support Vector Machine classifier

被引:85
作者
Moghaddam, Vahid Hooshmand [1 ]
Hamidzadeh, Javad [2 ]
机构
[1] Imam Reza Int Univ, Comp Engn, Mashhad, Iran
[2] Sadjad Univ Technol, Fac Comp Engn & Informat Technol, Mashhad, Iran
关键词
Support Vector Machine (SVM); Kernel function; Hermite orthogonal polynomial kernel; Combined kernel; FEATURE-SELECTION; REGRESSION; REDUCTION; ALGORITHM; MOMENTS; SVM;
D O I
10.1016/j.patcog.2016.07.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Support Vector Machine is a desired method for classification of different types of data, but the main obstacle to using this method is the considerable reduction of classification speed upon increase in the size of problem. In this paper, a new kernel function is proposed for SVM which is derived from Hermite orthogonal polynomials. This function improves classification accuracy as well as reduction in the number of support vectors and increases the classification speed. The overall kernel performance has been evaluated on real world data sets from UCI repository by the ten-fold cross-validation method. The combinations of Hermite function with common kernels are proposed in this paper. Experimental results reveal that the Hermite-Chebyshev kernel which is obtained from combination of Hermite and Chebyshev kernel, has the best performance in the number of support vectors and Hermite-Gussian kernel that is produced from combination Hermite and Gussian kernel, has the first rank in the error rate Among all experimental kernels. On the other hand the Hermite proposed method has the least number of support vectors and best,performance in the error rate in comparison with common kernels, and lowest required time among all kernels. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:921 / 935
页数:15
相关论文
共 43 条
[1]  
[Anonymous], 2003, STAT PATTERN RECOGNI
[2]  
[Anonymous], 1998, Technical Report
[3]  
[Anonymous], 1982, Pattern recognition: A statistical approach
[4]   THEORY OF REPRODUCING KERNELS [J].
ARONSZAJN, N .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1950, 68 (MAY) :337-404
[5]  
Bai L., 2015, MOL MED REP, V1, P1
[6]  
Bakir G.H., 2005, ADV NEURAL INFORM PR, P81
[7]  
Bi JB, 2005, PROC CVPR IEEE, P1121
[8]  
Caoa U., 2003, NEUROCOMPUTING, V55, P321
[9]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[10]   Exact simplification of support vector solutions [J].
Downs, T ;
Gates, KE ;
Masters, A .
JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (02) :293-297