Robust out-of-sample inference

被引:99
作者
McCracken, MW [1 ]
机构
[1] Louisiana State Univ, Dept Econ, Baton Rouge, LA 70803 USA
关键词
forecasting; forecast evaluation; hypothesis resting; model comparison;
D O I
10.1016/S0304-4076(00)00022-1
中图分类号
F [经济];
学科分类号
02 ;
摘要
This paper presents analytical, empirical and simulation results concerning inference about the moments of nondifferentiable functions of out-of-sample forecasts and forecast errors. Special attention is given to the measurement of a model's predictive ability using the test of equal mean absolute error. Tests for equal mean absolute error and mean square error are used to evaluate predictions of excess returns to the S & P 500 composite. Simulations indicate that appropriately constructed tests for equal mean absolute error can provide more accurately sized and more powerful tests than inappropriately constructed tests for equal mean absolute error and mean square error. (C) 2000 Elsevier Science S.A. All rights reserved. JEL classification: C52; C53; C32; C12.
引用
收藏
页码:195 / 223
页数:29
相关论文
共 46 条
[31]   Exploiting resampling techniques for model selection in forecasting: an empirical evaluation using out-of-sample tests [J].
Sarris, Dimitrios ;
Spiliotis, Evangelos ;
Assimakopoulos, Vassilios .
OPERATIONAL RESEARCH, 2020, 20 (02) :701-721
[32]   The U.S. Nonfarm Payroll and the out-of-sample predictability of output growth for over six decades [J].
Salisu A.A. ;
Olaniran A. .
Quality & Quantity, 2022, 56 (6) :4663-4673
[33]   Forecasting the onset of genocide and politicide: Annual out-of-sample forecasts on a global dataset, 1988-2003 [J].
Goldsmith, Benjamin E. ;
Butcher, Charles R. ;
Semenovich, Dimitri ;
Sowmya, Arcot .
JOURNAL OF PEACE RESEARCH, 2013, 50 (04) :437-452
[34]   Model Complexity and Out-of-Sample Performance: Evidence from S&P 500 Index Returns [J].
Kaeck, Andreas ;
Rodrigues, Paulo ;
Seeger, Norman J. .
JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 2018, 90 :1-29
[35]   Term Structure Modeling and Forecasting of Government Bond Yields Does a Good In-Sample Fit Imply Reasonable Out-of-Sample Forecasts? [J].
Ullah, Wali ;
Matsuda, Yasumasa ;
Tsukuda, Yoshihiko .
ECONOMIC PAPERS, 2013, 32 (04) :535-560
[36]   The out-of-sample performance of an exact median-unbiased estimator for the near-unity AR(1) model [J].
Medel, Carlos A. ;
Pincheira, Pablo M. .
APPLIED ECONOMICS LETTERS, 2016, 23 (02) :126-131
[37]   The arbitrage-free generalized Nelson–Siegel term structure model: Does a good in-sample fit imply better out-of-sample forecasts? [J].
Wali Ullah .
Empirical Economics, 2020, 59 :1243-1284
[38]   Generalized Nelson-Siegel term structure model: do the second slope and curvature factors improve the in-sample fit and out-of-sample forecasts? [J].
Ullah, Wali ;
Matsuda, Yasumasa ;
Tsukuda, Yoshihiko .
JOURNAL OF APPLIED STATISTICS, 2015, 42 (04) :876-904
[39]   The arbitrage-free generalized Nelson-Siegel term structure model: Does a good in-sample fit imply better out-of-sample forecasts? [J].
Ullah, Wali .
EMPIRICAL ECONOMICS, 2020, 59 (03) :1243-1284
[40]   Have structural changes eliminated the out-of-sample ability of financial variables to forecast real activity after the mid-1980s? Evidence from the Canadian economy [J].
Faroque, Akhter ;
Veloce, William ;
Lamarche, Jean-Francois .
APPLIED ECONOMICS, 2012, 44 (30) :3965-3985