Instance-based meta-learning for conditionally dependent univariate multi-step forecasting☆

被引:0
作者
Cerqueira, Vitor [1 ]
Torgo, Luis [1 ]
Bontempi, Gianluca [2 ]
机构
[1] Dalhousie Univ, Fac Comp Sci, 6050 Univ Ave, Halifax, NS B3H 1W5, Canada
[2] Univ Libre Bruxelles, Dept Informat, Machine Learning Grp, Brussels, Belgium
关键词
Time series; Multi-step forecasting; Meta-learning; Gradient Boosting; k-nearest neighbors; SERIES; PREDICTION; STRATEGIES; MODELS;
D O I
10.1016/j.ijforecast.2023.12.010
中图分类号
F [经济];
学科分类号
02 ;
摘要
Multi-step prediction is a key challenge in univariate forecasting. However, forecasting accuracy decreases as predictions are made further into the future. This is caused by the decreasing predictability and the error propagation along the horizon. In this paper, we propose a novel method called Forecasted Trajectory Neighbors (FTN) for multi-step forecasting with univariate time series. FTN is a meta-learning strategy that can be integrated with any state-of-the-art multi-step forecasting approach. It works by using training observations to correct the errors made during multiple predictions. This is accomplished by retrieving the nearest neighbors of the multi-step forecasts and averaging these for prediction. The motivation is to introduce, in a lightweight manner, a conditional dependent constraint across the forecasting horizons. Such a constraint, not always taken into account by most strategies, can be considered as a sort of regularization element. We carried out extensive experiments using 7795 time series from different application domains. We found that our method improves the performance of several state-of-the-art multi-step forecasting methods. An implementation of the proposed method is publicly available online, and the experiments are reproducible. Crown Copyright (c) 2024 Published by Elsevier B.V. on behalf of International Institute of Forecasters. All rights reserved.
引用
收藏
页码:1507 / 1520
页数:14
相关论文
共 32 条
[11]  
Bontempi G, 2013, LECT NOTES BUS INF P, V138, P62
[12]   Conditionally dependent strategies for multiple-step-ahead prediction in local learning [J].
Bontempi, Gianluca ;
Ben Taieb, Souhaib .
INTERNATIONAL JOURNAL OF FORECASTING, 2011, 27 (03) :689-699
[13]   A case study comparing machine learning with statistical methods for time series forecasting: size matters [J].
Cerqueira, Vitor ;
Torgo, Luis ;
Soares, Carlos .
JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2022, 59 (02) :415-433
[14]   Evaluating time series forecasting models: an empirical study on performance estimation methods [J].
Cerqueira, Vitor ;
Torgo, Luis ;
Mozetic, Igor .
MACHINE LEARNING, 2020, 109 (11) :1997-2028
[15]   Arbitrage of forecasting experts [J].
Cerqueira, Vitor ;
Torgo, Luis ;
Pinto, Falai ;
Soares, Carlos .
MACHINE LEARNING, 2019, 108 (06) :913-944
[16]   Nonparametric multistep-ahead prediction in time series analysis [J].
Chen, R ;
Yang, LJ ;
Hafner, C .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2004, 66 :669-686
[17]   DISCRIMINATORY ANALYSIS - NONPARAMETRIC DISCRIMINATION - CONSISTENCY PROPERTIES [J].
FIX, E ;
HODGES, JL .
INTERNATIONAL STATISTICAL REVIEW, 1989, 57 (03) :238-247
[18]   TIME-SERIES ANALYSIS - FORECASTING AND CONTROL - BOX,GEP AND JENKINS,GM [J].
GEURTS, M .
JOURNAL OF MARKETING RESEARCH, 1977, 14 (02) :269-269
[19]  
Guo MH, 1999, STAT SINICA, V9, P559
[20]   Multi-step ahead time series forecasting via sparse coding and dictionary based techniques [J].
Helmi, Ahmed ;
Fakhr, Mohamed W. ;
Atiya, Amir F. .
APPLIED SOFT COMPUTING, 2018, 69 :464-474