Choosing the kernel parameters for support vector machines by the inter-cluster distance in the feature space

被引:164
作者
Wu, Kuo-Ping [1 ]
Wang, Sheng-De [1 ]
机构
[1] Natl Taiwan Univ, Dept Elect Engn, Taipei 10764, Taiwan
关键词
SVM; Support vector machines; Kernel parameters; Inter-cluster distances; DECOMPOSITION;
D O I
10.1016/j.patcog.2008.08.030
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Determining the kernel and error penalty parameters for support vector machines (SVMs) is very problem-dependent in practice. A popular method to deciding the kernel parameters is the grid search method. In the training process, classifiers are trained with different kernel parameters, and only one of the classifiers is required for the testing process. This makes the training process time-consuming. In this paper we propose using the inter-cluster distances in the feature spaces to choose the kernel parameters. Calculating such distance costs much less computation time than training the corresponding SVM classifiers; thus the proper kernel parameters can be chosen much faster. Experiment results show that the inter-cluster distance can choose proper kernel parameters with which the testing accuracy of trained SVMs is competitive to the standard ones, and the training time can be significantly shortened. (C) 2008 Elsevier Ltd. All rights reserved
引用
收藏
页码:710 / 717
页数:8
相关论文
共 28 条
  • [1] Ancona N, 2002, INT C PATT RECOG, P426, DOI 10.1109/ICPR.2002.1048330
  • [2] [Anonymous], PRACTICAL GUIDE SUPP
  • [3] Some new indexes of cluster validity
    Bezdek, JC
    Pal, NR
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1998, 28 (03): : 301 - 315
  • [4] Bi LP, 2005, PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9, P4299
  • [5] BOTTOU L, 1994, INT C PATT RECOG, P77, DOI 10.1109/ICPR.1994.576879
  • [6] Chang C.-C., LIBSVM: a Library for Support Vector Machines
  • [7] Collobert R., TORCH
  • [8] Debnath R, 2004, IEEE INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES 2004 (ISCIT 2004), PROCEEDINGS, VOLS 1 AND 2, P1023
  • [9] Fast SVM training algorithm with decomposition on very large data sets
    Dong, JX
    Krzyzak, A
    Suen, CY
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (04) : 603 - 618
  • [10] A comparison of methods for multiclass support vector machines
    Hsu, CW
    Lin, CJ
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02): : 415 - 425