Kernel parameter selection for support vector machine classification

被引：0

作者：

Liu, Zhiliang ^{[1
]}

Xu, Hongbing ^{[1
]}

机构：

[1] School of Mechanical, Electronic Industrial Engineering, University of Electronic Science and Technology of China, Chengdu

来源：

Journal of Algorithms and Computational Technology | 2014年 / 8卷 / 02期

关键词：

cosine similarity; kernel function; parameter selection; support vector machine;

D O I：

10.1260/1748-3018.8.2.163

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Parameter selection for kernel functions is important to the robust classification performance of a support vector machine (SVM). This paper introduces a parameter selection method for kernel functions in SVM. The proposed method tries to estimate the class separability by cosine similarity in the kernel space. The optimal parameter is defined as the one that can maximize the between-class separability and minimize the within-class separability. The experiments for several kernel functions are conducted on eight benchmark datasets. The results demonstrate that our method is much faster than grid search with comparable classification accuracy. We also found that the proposed method is an extension of a reported method in reference [2].

引用

页码：163 / 177

页数：14

共 21 条

[1]

Vapnik V.N., Statistical Learning Theory, (1998)

[2]

Li C.-H., Ho H.-H., Liu Y.-L., Lin C.-T., Kuo B.-C., Taur J.-S., An automatic method for selecting the parameter of the normalized kernel function to support vector machines, Journal of Information Science and Engineering, 28, 1, pp. 1-15, (2012)

[3]

Gualdron O., Brezmes J., Llobet E., Amari A., Vilanova X., Bouchikhi B., Correig X., Variable selection for support vector machine based multisensor systems, Sensors and Actuators, B: Chemical, 122, 1, pp. 259-268, (2007)

[4]

Wang W., Xu Z., Lu W., Zhang X., Determination of the spread parameter in the Gaussian kernel for classification and regression, Neurocomputing, 55, 3-4, pp. 643-663, (2003)

[5]

Yuan S.-F., Chu F.-L., Support vector machines-based fault diagnosis for turbo-pump rotor, Mechanical Systems and Signal Processing, 20, 4, pp. 939-952, (2006)

[6]

Qu J., Liu Z., Zuo M.J., Huang H.-Z., Feature selection for damage degree classification of planetary gearboxes using support vector machine, proceedings of the institution of mechanical engineers, part c, Journal of Mechanical Engineering Science, 225, 9, pp. 2250-2264, (2011)

[7]

Villa A., Fauvel M., Chanussot J., Gamba P., Benediktsson J.A., Gradient optimization for multiple kernel's parameters in support vector machines classification, Proceedings of IEEE International Conference on Geoscience and Remote Sensing Symposium, (2008)

[8]

Widodoa A., Kimb E.Y., Sonc J.-D., Yang B.-S., Tanb A.C.C., Gud D.-S., Choid B.-K., Mathewb J., Fault diagnosis of low speed bearing based on relevance vector machine and support vector machine, Expert Systems with Applications, 36, 3, pp. 7252-7261, (2009)

[9]

Xu Z., Dai M., Meng D., Fast and efficient strategies for model selection of gaussian support vector machine, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 39, 5, pp. 1292-1307, (2009)

[10]

Ali S., Smith K.A., Automatic parameter selection for polynomial kernel, Proceedings of IEEE International Conference on Information Reuse and Integration, (2003)

← 1 2 3 →