Multivariate time series forecasting via attention-based encoder-decoder framework

被引:297
作者
Du, Shengdong [1 ]
Li, Tianrui [1 ]
Yang, Yan [1 ]
Horng, Shi-Jinn [2 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] Natl Taiwan Univ Sci & Technol, Dept Comp Sci & Informat Engn, Taipei 10607, Taiwan
基金
中国国家自然科学基金;
关键词
Multivariate time series; Temporal attention; Multi-step forecasting; Encoder-decoder; Deep learning; Long short-term memory networks; PREDICTION; NETWORK;
D O I
10.1016/j.neucom.2019.12.118
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series forecasting is an important technique to study the behavior of temporal data and forecast future values, which is widely applied in many fields, e.g. air quality forecasting, power load forecasting, medical monitoring, and intrusion detection. In this paper, we firstly propose a novel temporal attention encoder-decoder model to deal with the multivariate time series forecasting problem. It is an end-to-end deep learning structure that integrates the traditional encode context vector and temporal attention vector for jointly temporal representation learning, which is based on bi-directional long short-term memory networks (Bi-LSTM) layers with temporal attention mechanism as the encoder network to adaptively learning long-term dependency and hidden correlation features of multivariate temporal data. Extensive experimental results on five typical multivariate time series datasets showed that our model has the best forecasting performance compared with baseline methods. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:269 / 279
页数:11
相关论文
共 46 条
[1]   Unsupervised real-time anomaly detection for streaming data [J].
Ahmad, Subutai ;
Lavin, Alexander ;
Purdy, Scott ;
Agha, Zuha .
NEUROCOMPUTING, 2017, 262 :134-147
[2]   An Empirical Comparison of Machine Learning Models for Time Series Forecasting [J].
Ahmed, Nesreen K. ;
Atiya, Amir F. ;
El Gayar, Neamat ;
El-Shishiny, Hisham .
ECONOMETRIC REVIEWS, 2010, 29 (5-6) :594-621
[3]  
[Anonymous], 2018, ARXIV180503714
[4]  
[Anonymous], 2016, PROC ICML
[5]  
[Anonymous], ARXIV170703321
[6]  
Bahdanau D., 2014, arXiv preprint arXiv:1409. 0473
[7]  
Bahdanau D., 2014, EMNLP, DOI 10.3115/v1/d14
[8]   Multi-step-ahead time series prediction using multiple-output support vector regression [J].
Bao, Yukun ;
Xiong, Tao ;
Hu, Zhongyi .
NEUROCOMPUTING, 2014, 129 :482-493
[9]   A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition [J].
Ben Taieb, Souhaib ;
Bontempi, Gianluca ;
Atiya, Amir F. ;
Sorjamaa, Antti .
EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (08) :7067-7083
[10]  
Box G.E., 1970, J. Amer. Statist. Assoc., V65, P1509, DOI DOI 10.1080/01621459.1970.10481180