Multivariate Segment Expandable Encoder-Decoder Model for Time Series Forecasting

被引:0
作者
Li, Yanhong [1 ]
Anastasiu, David C. [1 ]
机构
[1] Santa Clara Univ, Comp Sci & Engn Dept, Santa Clara, CA 95053 USA
关键词
Time series analysis; Forecasting; Predictive models; Accuracy; Transformers; Rain; Data models; Kurtosis; Heavily-tailed distribution; Deep learning; representation learning; oversampling policy; streamflow prediction; hydrologic prediction; LSTM; time series;
D O I
10.1109/ACCESS.2024.3513256
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate time series forecasting is critical in a variety of fields, including transportation, weather prediction, energy management, infrastructure monitoring, and finance. Forecasting highly skewed and heavy-tailed time series, particularly in multivariate environments, is still difficult. In these cases, accurately capturing the relationships between variables is critical for successful model design. This is especially true when dealing with extreme events like droughts or floods in streamflow forecasting, which can have severe consequences on public safety and social well-being. We present the Multivariate Segment-Expandable Encoder Decoder (MSEED), a novel framework designed to address the challenges of extreme-adaptive multivariate time series forecasting. MSEED features a hierarchical encoder-decoder architecture, a short-term-enhanced subnet, and a feature assembling layer that integrates spatial and temporal information across multivariate inputs. By capturing quantile distributions across segmented subsequences at multiple scales, the model is able to detect complex patterns, enhancing both the accuracy and robustness of forecasts. Additionally, MSEED incorporates a simple vanilla encoder-decoder model for strengthening rolling predictions. The framework has been tested on four challenging real-world datasets, focusing on two critical forecasting scenarios: long-term predictions (three days ahead) and rolling predictions (every four hours) to simulate real-time decision-making in water resource management. MSEED consistently outperforms state-of-the-art models, showing improvements in forecasting accuracy ranging from 18% to 74%.
引用
收藏
页码:185012 / 185026
页数:15
相关论文
共 48 条
[1]  
Agrawal R., 1995, VLDB '95. Proceedings of the 21st International Conference on Very Large Data Bases, P490
[2]  
An J., 2015, SPECIAL LECT IE, V2, P1
[3]   Estimation of the extreme-value index and generalized quantile plots [J].
Beirlant, J ;
Dierckx, G ;
Guillou, A .
BERNOULLI, 2005, 11 (06) :949-970
[4]  
Box G.E. P., 1976, TIME SERIES ANAL FOR
[5]  
Cao DF, 2020, ADV NEUR IN, V33
[6]   Efficient time series matching by wavelets [J].
Chan, KP ;
Fu, AWC .
15TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, PROCEEDINGS, 1999, :126-133
[7]   SMOTEBoost: Improving prediction of the minority class in boosting [J].
Chawla, NV ;
Lazarevic, A ;
Hall, LO ;
Bowyer, KW .
KNOWLEDGE DISCOVERY IN DATABASES: PKDD 2003, PROCEEDINGS, 2003, 2838 :107-119
[8]   CANONICAL PIECEWISE-LINEAR ANALYSIS [J].
CHUA, LO ;
YING, RLP .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1983, 30 (03) :125-140
[9]   Modeling Extreme Events in Time Series Prediction [J].
Ding, Daizong ;
Zhang, Mi ;
Pan, Xudong ;
Yang, Min ;
He, Xiangnan .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :1114-1122
[10]   Short-Term Load Forecasting Using Encoder-Decoder WaveNet: Application to the French Grid [J].
Dorado Rueda, Fernando ;
Duran Suarez, Jaime ;
del Real Torres, Alejandro .
ENERGIES, 2021, 14 (09)