Nonlinear forecasting with many predictors using kernel ridge regression

被引:73
作者
Exterkate, Peter [1 ,2 ]
Groenen, Patrick J. F. [3 ,4 ,7 ]
Heij, Christiaan [5 ]
van Dijk, Dick [6 ,7 ,8 ]
机构
[1] Univ Sydney, Sch Econ, Econometr, Sydney, NSW 2006, Australia
[2] Aarhus Univ, CREATES, Ctr Res Econometr Anal Time Series, DK-8000 Aarhus C, Denmark
[3] Erasmus Univ, Inst Econometr, Stat, NL-3000 DR Rotterdam, Netherlands
[4] Erasmus Univ, Inst Econometr, NL-3000 DR Rotterdam, Netherlands
[5] Erasmus Univ, Inst Econometr, Econometr & Stat, NL-3000 DR Rotterdam, Netherlands
[6] Erasmus Univ, Inst Econometr, Financial Econometr, NL-3000 DR Rotterdam, Netherlands
[7] Erasmus Univ, Erasmus Res Inst Management, NL-3000 DR Rotterdam, Netherlands
[8] Erasmus Univ, Tinbergen Inst, NL-3000 DR Rotterdam, Netherlands
基金
新加坡国家研究基金会;
关键词
High dimensionality; Nonlinear forecasting; Ridge regression; Kernel methods; TIME-SERIES; CROSS-VALIDATION; MODEL-SELECTION; NEURAL-NETWORKS; LINEAR-MODELS; US INFLATION; SHRINKAGE; INFORMATION; VARIABLES;
D O I
10.1016/j.ijforecast.2015.11.017
中图分类号
F [经济];
学科分类号
02 ;
摘要
This paper puts forward kernel ridge regression as an approach for forecasting with many predictors that are related to the target variable nonlinearly. In kernel ridge regression, the observed predictor variables are mapped nonlinearly into a high-dimensional space, where estimation of the predictive regression model is based on a shrinkage estimator in order to avoid overfitting. We extend the kernel ridge regression methodology to enable its use for economic time series forecasting, by including lags of the dependent variable or other individual variables as predictors, as is typically desired in macroeconomic and financial applications. Both Monte Carlo simulations and an empirical application to various key measures of real economic activity confirm that kernel ridge regression can produce more accurate forecasts than traditional linear and nonlinear methods for dealing with many predictors based on principal components. (C) 2016 International Institute of Forecasters. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:736 / 753
页数:18
相关论文
共 45 条
[11]   Efficient approximate leave-one-out cross-validation for kernel logistic regression [J].
Cawley, Gavin C. ;
Talbot, Nicola L. C. .
MACHINE LEARNING, 2008, 71 (2-3) :243-264
[12]  
Chen XH, 2007, HBK ECON, V2, P5549, DOI 10.1016/S1573-4412(07)06076-X
[13]   Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components? [J].
De Mol, Christine ;
Giannone, Domenico ;
Reichlin, Lucrezia .
JOURNAL OF ECONOMETRICS, 2008, 146 (02) :318-328
[14]   Complete subset regressions [J].
Elliott, Graham ;
Gargano, Antonio ;
Timmermann, Allan .
JOURNAL OF ECONOMETRICS, 2013, 177 (02) :357-373
[15]   Model selection in kernel ridge regression [J].
Exterkate, Peter .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 68 :1-16
[16]   Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset [J].
Faust, Jon ;
Wright, Jonathan H. .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2009, 27 (04) :468-479
[17]   A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS [J].
FRANK, IE ;
FRIEDMAN, JH .
TECHNOMETRICS, 1993, 35 (02) :109-135
[18]   Nonlinear Forecasting Using Factor-Augmented Models [J].
Giovannetti, Bruno Cara .
JOURNAL OF FORECASTING, 2013, 32 (01) :32-40
[19]  
Groen J. J. J., 2008, 327 FED RES BANK NEW
[20]   Least squares model averaging [J].
Hansen, Bruce E. .
ECONOMETRICA, 2007, 75 (04) :1175-1189