Analysis of a Random Forests Model

被引：0

作者：

Biau, Gerard ^{[1
,2
]}

机构：

[1] Univ Paris 06, LSTA & LPMA, F-75252 Paris 05, France

[2] Ecole Normale Super, DMA, F-75230 Paris 05, France

来源：

JOURNAL OF MACHINE LEARNING RESEARCH | 2012年 / 13卷

关键词：

random forests; randomization; sparsity; dimension reduction; consistency; rate of convergence; REGRESSION;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Random forests are a scheme proposed by Leo Breiman in the 2000's for building a predictor ensemble with a set of decision trees that grow in randomly selected subspaces of data. Despite growing interest and practical use, there has been little exploration of the statistical properties of random forests, and little is known about the mathematical forces driving the algorithm. In this paper, we offer an in-depth analysis of a random forests model suggested by Breiman (2004), which is very close to the original algorithm. We show in particular that the procedure is consistent and adapts to sparsity, in the sense that its rate of convergence depends only on the number of strong features and not on how many noise variables are present.

引用

页码：1063 / 1095

页数：33

共 50 条

[21] Research of Text Categorization Model based on Random Forests [J].

Xue, Dashen ;

Li, Fengxin .

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION TECHNOLOGY CICT 2015, 2015, :173-176

[22] Random forests [J].

Breiman, L .

MACHINE LEARNING, 2001, 45 (01) :5-32

[23] Random Forests [J].

Leo Breiman .

Machine Learning, 2001, 45 :5-32

[24] Grouped variable importance with random forests and application to multiple functional data analysis [J].

Gregorutti, Baptiste ;

Michel, Bertrand ;

Saint-Pierre, Philippe .

COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2015, 90 :15-35

[25] Performance analysis of set partitioning formulations on the rule extraction from random forests [J].

Edali, Mert .

PAMUKKALE UNIVERSITY JOURNAL OF ENGINEERING SCIENCES-PAMUKKALE UNIVERSITESI MUHENDISLIK BILIMLERI DERGISI, 2021, 27 (04) :513-519

[26] A Novel Consistent Random Forest Framework: Bernoulli Random Forests [J].

Wang, Yisen ;

Xia, Shu-Tao ;

Tang, Qingtao ;

Wu, Jia ;

Zhu, Xingquan .

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (08) :3510-3523

[27] Regression conformal prediction with random forests [J].

Johansson, Ulf ;

Bostrom, Henrik ;

Lofstrom, Tuve ;

Linusson, Henrik .

MACHINE LEARNING, 2014, 97 (1-2) :155-176

[28] Neural networks meet random forests [J].

Qiu, Rui ;

Xu, Shuntuo ;

Yu, Zhou .

JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2024, 86 (05) :1435-1454

[29] Unbiased variable importance for random forests [J].

Loecher, Markus .

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2022, 51 (05) :1413-1425

[30] Regression conformal prediction with random forests [J].

Ulf Johansson ;

Henrik Boström ;

Tuve Löfström ;

Henrik Linusson .

Machine Learning, 2014, 97 :155-176

← 1 2 3 4 5 →