Modeling of time series using random forests: Theoretical developments

被引:18
作者
Davis, Richard A. [1 ]
Nielsen, Mikkel S. [1 ]
机构
[1] Columbia Univ, Dept Stat, New York, NY 10027 USA
关键词
Markov processes; nonlinear autoregressive models; nonparametric regression; random forests; REGRESSION; CLASSIFICATION;
D O I
10.1214/20-EJS1758
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper we study asymptotic properties of random forests within the framework of nonlinear time series modeling. While random forests have been successfully applied in various fields, the theoretical justification has not been considered for their use in a time series setting. Under mild conditions, we prove a uniform concentration inequality for regression trees built on nonlinear autoregressive processes and, subsequently, we use this result to prove consistency for a large class of random forests. The results are supported by various simulations.
引用
收藏
页码:3644 / 3671
页数:28
相关论文
共 29 条
[1]   UNIFORM CONVERGENCE OF VAPNIK-CHERVONENKIS CLASSES UNDER ERGODIC SAMPLING [J].
Adams, Terrence M. ;
Nobel, Andrew B. .
ANNALS OF PROBABILITY, 2010, 38 (04) :1345-1367
[2]   Enriched random forests [J].
Amaratunga, Dhammika ;
Cabrera, Javier ;
Lee, Yung-Seop .
BIOINFORMATICS, 2008, 24 (18) :2010-2014
[3]  
An HZ, 1996, STAT SINICA, V6, P943
[4]  
[Anonymous], 2012, STRAT C PRES FEBR
[5]  
[Anonymous], 2014, ARXIV14073939
[6]   A random forest guided tour [J].
Biau, Gerard ;
Scornet, Erwan .
TEST, 2016, 25 (02) :197-227
[7]  
Biau G, 2012, J MACH LEARN RES, V13, P1063
[8]   On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification [J].
Biau, Gerard ;
Devroye, Luc .
JOURNAL OF MULTIVARIATE ANALYSIS, 2010, 101 (10) :2499-2518
[9]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[10]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32