A comparison of random forest based algorithms: random credal random forest versus oblique random forest

被引:71
作者
Mantas, Carlos J. [1 ]
Castellano, Javier G. [1 ]
Moral-Garcia, Serafin [1 ]
Abellan, Joaquin [1 ]
机构
[1] Univ Granada, Dept Comp Sci & Artificial Intelligence, Granada, Spain
关键词
Classification; Ensemble schemes; Random forest; Imprecise probabilities; Credal sets; RIDGE-REGRESSION; IMPRECISE PROBABILITIES; UNCERTAINTY MEASURES; DECISION TREES; CLASS NOISE; ENSEMBLE; CLASSIFICATION; CLASSIFIERS; MODEL;
D O I
10.1007/s00500-018-3628-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Random forest (RF) is an ensemble learning method, and it is considered a reference due to its excellent performance. Several improvements in RF have been published. A kind of improvement for the RF algorithm is based on the use of multivariate decision trees with local optimization process (oblique RF). Another type of improvement is to provide additional diversity for the univariate decision trees by means of the use of imprecise probabilities (random credal random forest, RCRF). The aim of this work is to compare experimentally these improvements of the RF algorithm. It is shown that the improvement in RF with the use of additional diversity and imprecise probabilities achieves better results than the use of RF with multivariate decision trees.
引用
收藏
页码:10739 / 10754
页数:16
相关论文
共 41 条
[1]   AdaptativeCC4.5: Credal C4.5 with a rough class noise estimator [J].
Abelian, Joaquin ;
Mantas, Carlos J. ;
Castellano, Javier G. .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 92 :363-379
[3]   Building classification trees using the total uncertainty criterion [J].
Abellán, J ;
Moral, S .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2003, 18 (12) :1215-1225
[4]   Requirements for total uncertainty measures in Dempster-Shafer theory of evidence [J].
Abellan, Joaquin ;
Masegosa, Andres .
INTERNATIONAL JOURNAL OF GENERAL SYSTEMS, 2008, 37 (06) :733-747
[5]   Increasing diversity in random forest learning algorithm via imprecise probabilities [J].
Abellan, Joaquin ;
Mantas, Carlos J. ;
Castellano, Javier G. ;
Moral-Garcia, SerafIn .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 97 :228-243
[6]   Bagging schemes on the presence of class noise in classification [J].
Abellan, Joaquin ;
Masegosa, Andres R. .
EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (08) :6827-6837
[7]   KEEL: a software tool to assess evolutionary algorithms for data mining problems [J].
Alcala-Fdez, J. ;
Sanchez, L. ;
Garcia, S. ;
del Jesus, M. J. ;
Ventura, S. ;
Garrell, J. M. ;
Otero, J. ;
Romero, C. ;
Bacardit, J. ;
Rivas, V. M. ;
Fernandez, J. C. ;
Herrera, F. .
SOFT COMPUTING, 2009, 13 (03) :307-318
[8]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[9]   Randomizing outputs to increase prediction accuracy [J].
Breiman, L .
MACHINE LEARNING, 2000, 40 (03) :229-242
[10]  
Brown G., 2005, Information Fusion, V6, P5, DOI 10.1016/j.inffus.2004.04.004