Accelerating the SVM learning for very large data sets

被引:0
作者
Sung, Eric [1 ]
Yan, Zhu [1 ]
Li Xuchun [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
来源
18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS | 2006年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an original sequential learning algorithm, SBA, that enables the SVM to efficiently learn from only a small subset of the input data set. The principle is based on sequentially adding convex hull points of the binary classes to a small subset. The SVM is trained on the current training pool and its result. is used to find the data which is wrongly classsified and furthest away from the current optimal hyperplane. This point is added to the training pool and the SVM is retrained on it. The iteration stops when no more suchpoints are found A formal proof of strict convergence is provided and we derive a geometric bound on the training time. It will be explained how SBA can be extended to handle non-linearly and non-separable class distributions. Experimental trials on some well known data sets verify the speed advantage of our method coupled to any SVM over that of that SVM used and the core vector machine.
引用
收藏
页码:484 / +
页数:2
相关论文
共 12 条
  • [1] [Anonymous], 1982, ESTIMATION DEPENDENC
  • [2] Burges C., 1998, DATA MINING KNOWLEDG
  • [3] FRIESS TT, 1998, SUPPORT VECTOR NETWO
  • [4] Joachims J., 1999, ADV KERNEL METHODS S
  • [5] A fast iterative nearest point algorithm for support vector machine classifier design
    Keerthi, SS
    Shevade, SK
    Bhattacharyya, C
    Murthy, KRK
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (01): : 124 - 136
  • [6] Lagrangian support vector machines
    Mangasaian, OL
    Musicant, DR
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (03) : 161 - 177
  • [7] OSUNA E, 1997, P IEEE NNSP 97
  • [8] Platt J., 1998, MICROSOFT RES
  • [9] Scholkopf B., 1998, Advances in Kernel Methods-Support Vector Learning
  • [10] Shin H, 2003, LECT NOTES ARTIF INT, V2637, P376