Random Forests

被引:222
作者
Leo Breiman
机构
[1] University of California,Statistics Department
来源
Machine Learning | 2001年 / 45卷
关键词
classification; regression; ensemble;
D O I
暂无
中图分类号
学科分类号
摘要
Random forests are a combination of tree predictors such that each tree depends on the values of a random vector sampled independently and with the same distribution for all trees in the forest. The generalization error for forests converges a.s. to a limit as the number of trees in the forest becomes large. The generalization error of a forest of tree classifiers depends on the strength of the individual trees in the forest and the correlation between them. Using a random selection of features to split each node yields error rates that compare favorably to Adaboost (Y. Freund & R. Schapire, Machine Learning: Proceedings of the Thirteenth International conference, ***, 148–156), but are more robust with respect to noise. Internal estimates monitor error, strength, and correlation and these are used to show the response to increasing the number of features used in the splitting. Internal estimates are also used to measure variable importance. These ideas are also applicable to regression.
引用
收藏
页码:5 / 32
页数:27
相关论文
共 12 条
[1]  
Amit Y.(1997)Shape quantization and recognition with randomized trees Neural Computation 9 1545-1588
[2]  
Geman D.(1999)An empirical comparison of voting classification algorithms Machine Learning 36 105-139
[3]  
Bauer E.(1996)Bagging predictors Machine Learning 26 123-140
[4]  
Kohavi R.(1998)Arcing classifiers (discussion paper) Annals of Statistics 26 801-824
[5]  
Breiman L.(1998)The random subspace method for constructing decision forests IEEE Trans. on Pattern Analysis and Machine Intelligence 20 832-844
[6]  
Breiman L.(2000)On the algorithmic implementation of stochastic discrimination IEEE Trans. on Pattern Analysis and Machine Intelligence 22 473-490
[7]  
Ho T. K.(1998)Boosting the margin:Anewexplanation for the effectiveness of voting methods Annals of Statistics 26 1651-1686
[8]  
Kleinberg E.(undefined)undefined undefined undefined undefined-undefined
[9]  
Schapire R.(undefined)undefined undefined undefined undefined-undefined
[10]  
Freund Y.(undefined)undefined undefined undefined undefined-undefined