An empirical comparison of ensemble classification algorithms with support vector machines

被引:0
作者
Hu, ZH [1 ]
Li, YG [1 ]
Cai, YZ [1 ]
Xu, XM [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200030, Peoples R China
来源
PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7 | 2004年
关键词
ensemble classification; boosting; bagging; support vector machines;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An ensemble classifier often has better performance than any of the single learned classifiers in the ensemble. In this paper, the trained support vector machine (SVM) classifiers are used as basic classifiers. The ensemble methods for creating ensemble classifier, such as Bagging and Boosting, etc., are evaluated on two data sets. Some conclusions are obtained. Bagging with SVM can stably improve classification accuracy, while the improvement obtained by Boosting with SVM is not obvious. These two methods largely increase space complexity and time complexity. Comparatively, the multiple SVM decision model, training individual SVM classifiers using training subsets obtained by partitioning the original training set, has a better trade-off between the classification accuracy and efficiency.
引用
收藏
页码:3520 / 3523
页数:4
相关论文
共 13 条
[1]  
[Anonymous], 2001, Data mining: concepts and techniques
[2]  
[Anonymous], 1990, Report No
[3]  
BAUER E, 1998, MACH LEARN, P38
[4]  
Breiman L., 1994, 421 U CAL DEP STAT
[5]  
Burges C. J. C., 1998, TUTORIAL SUPPORT VEC
[6]  
Cristianini N., 2000, Intelligent Data Analysis: An Introduction, DOI 10.1017/CBO9780511801389
[7]  
FRANKE J, NEURAL COMPUTATION, V12, P1929
[8]  
Maclin R., 1999, J ARTIF INTELL RES, V11, P169, DOI [DOI 10.1613/JAIR.614, 10.1613/jair.614]
[9]  
Platt J., 1998, MICROSOFT RES
[10]  
PRECHELT L, 1994, 2194 U KARLSR FAK IN