Ensemble Method of Effective AdaBoost Algorithm for Decision Tree Classifiers

被引:13
作者
Dinakaran, S. [1 ]
Thangaiah, P. Ranjit Jeba [1 ]
机构
[1] Karunya Univ, Dept Comp Applicat, Coimbatore, Tamil Nadu, India
关键词
Ensemble method; boosting; classifier; AdaBoost; decision stump; C4.5; NB tree; random forest; pairwise comparison; STATISTICAL COMPARISONS; DATA SETS; CLASSIFICATION; LOCALIZATION;
D O I
10.1142/S0218213017500075
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article introduces a novel ensemble method named eAdaBoost (Effective Adaptive Boosting) is a meta classifier which is developed by enhancing the existing AdaBoost algorithm and to handle the time complexity and also to produce the best classification accuracy. The eAdaBoost reduces the error rate when compared with the existing methods and generates the best accuracy by reweighing each feature for further process. The comparison results of an extensive experimental evaluation of the proposed method are explained using the UCI machine learning repository datasets. The accuracy of the classifiers and statistical test comparisons are made with various boosting algorithms. The proposed eAdaBoost has been also implemented with different decision tree classifiers like C4.5, Decision Stump, NB Tree and Random Forest. The algorithm has been computed with various dataset, with different weight thresholds and the performance is analyzed. The proposed method produces better results using random forest and NB tree as base classifier than the decision stump and C4.5 classifiers for few datasets. The eAdaBoost gives better classification accuracy, and prediction accuracy, and execution time is also less when compared with other classifiers.
引用
收藏
页数:21
相关论文
共 34 条
  • [1] [Anonymous], P 13 INT S STRING PR
  • [2] Predicting the outcome of construction litigation using boosted decision trees
    Arditi, D
    Pulket, T
    [J]. JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2005, 19 (04) : 387 - 393
  • [3] Random forests
    Breiman, L
    [J]. MACHINE LEARNING, 2001, 45 (01) : 5 - 32
  • [4] Random forests
    Breiman, L
    [J]. MACHINE LEARNING, 2001, 45 (01) : 5 - 32
  • [5] On the use of MapReduce for imbalanced big data using Random Forest
    del Rio, Sara
    Lopez, Victoria
    Manuel Benitez, Jose
    Herrera, Francisco
    [J]. INFORMATION SCIENCES, 2014, 285 : 112 - 137
  • [6] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [7] Dinakaran S., 2013, INT J SCI ENG RES, V4
  • [8] Hybrid decision tree and naive Bayes classifiers for multi-class classification tasks
    Farid, Dewan Md.
    Zhang, Li
    Rahman, Chowdhury Mofizur
    Hossain, M. A.
    Strachan, Rebecca
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (04) : 1937 - 1946
  • [9] Ferreira AJ, 2012, ENSEMBLE MACHINE LEARNING: METHODS AND APPLICATIONS, P35, DOI 10.1007/978-1-4419-9326-7_2
  • [10] Freund Y, 1999, MACHINE LEARNING, PROCEEDINGS, P124