A Multiscale Interactive Recurrent Network for Time-Series Forecasting

被引:22
作者
Chen, Donghui [1 ]
Chen, Ling [1 ]
Zhang, Youdong [2 ]
Wen, Bo [2 ]
Yang, Chenghu [2 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Alibaba Grp, Hangzhou 311100, Peoples R China
关键词
Time series analysis; Forecasting; Predictive models; Logic gates; Task analysis; Recurrent neural networks; Optimization; Attention mechanism; multiscale modeling; recurrent neural network (RNN); time-series forecasting;
D O I
10.1109/TCYB.2021.3055951
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time-series forecasting is a key component in the automation and optimization of intelligent applications. It is not a trivial task, as there are various short-term and/or long-term temporal dependencies. Multiscale modeling has been considered as a promising strategy to solve this problem. However, the existing multiscale models either apply an implicit way to model the temporal dependencies or ignore the interrelationships between multiscale subseries. In this article, we propose a multiscale interactive recurrent network (MiRNN) to jointly capture multiscale patterns. MiRNN employs a deep wavelet decomposition network to decompose the raw time series into multiscale subseries. MiRNN introduces three key strategies (truncation, initialization, and message passing) to model the inherent interrelationships between multiscale subseries, as well as a dual-stage attention mechanism to capture multiscale temporal dependencies. Experiments on four real-world datasets demonstrate that our model achieves promising performance compared with the state-of-the-art methods.
引用
收藏
页码:8793 / 8803
页数:11
相关论文
共 42 条
[1]  
[Anonymous], 2017, ARXIV170507393
[2]  
Bai Shaojie, 2018, CoRR
[3]   LSTM-MSNet: Leveraging Forecasts on Sets of Related Time Series With Multiple Seasonal Patterns [J].
Bandara, Kasun ;
Bergmeir, Christoph ;
Hewamalage, Hansika .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (04) :1586-1599
[4]   Describing Video With Attention-Based Bidirectional LSTM [J].
Bin, Yi ;
Yang, Yang ;
Shen, Fumin ;
Xie, Ning ;
Shen, Heng Tao ;
Li, Xuelong .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (07) :2631-2641
[5]  
Chang SY, 2017, ADV NEUR IN, V30
[6]   Recurrent Neural Networks for Multivariate Time Series with Missing Values [J].
Che, Zhengping ;
Purushotham, Sanjay ;
Cho, Kyunghyun ;
Sontag, David ;
Liu, Yan .
SCIENTIFIC REPORTS, 2018, 8
[7]  
Chen L., 2020, INF SCI, V555, P17
[8]  
Chung J., 2016, Hierarchical multiscale recurrent neural networks
[9]  
Cui Z, 2016, MULTISCALE CONVOLU T
[10]   Multi-Horizon Time Series Forecasting with Temporal Attention Learning [J].
Fan, Chenyou ;
Zhang, Yuze ;
Pan, Yi ;
Li, Xiaoyue ;
Zhang, Chi ;
Yuan, Rong ;
Wu, Di ;
Wang, Wensheng ;
Pei, Jian ;
Huang, Heng .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2527-2535