Multi-task prediction model based on ConvLSTM and encoder-decoder

被引:10
作者
Luo, Tao [1 ]
Cao, Xudong [1 ]
Li, Jin [1 ]
Dong, Kun [1 ]
Zhang, Rui [1 ]
Wei, Xueliang [1 ]
机构
[1] China Univ Petr, Coll Informat Sci & Engn, Beijing 102200, Peoples R China
关键词
Encoder-decoder architecture; CNN; ConvLSMT; LSTM; deep learning; attention mechanism; multi-task learning; multi-step prediction; load forecasting; micro-energy network; multi-time scale;
D O I
10.3233/IDA-194969
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The energy load data in the micro-energy network are a time series with sequential and nonlinear characteristics. This paper proposes a model based on the encode-decode architecture and ConvLSTM for multi-scale prediction of multi-energy loads in the micro-energy network. We apply ConvLSTM, LSTM, attention mechanism and multi-task learning concepts to construct a model specifically for processing the energy load forecasting of the micro-energy network. In this paper, ConvLSTM is used to encode the input time series. The attention mechanism is used to assign different weights to the features, which are subsequently decoded by the decoder LSTM layer. Finally, the fully connected layer interprets the output. This model is applied to forecast the multi-energy load data of the micro-energy network in a certain area of Northwest China. The test results prove that our model is convergent, and the evaluation index value of the model is better than that of the multi-task FC-LSTM and the single-task FC-LSTM. In particular, the application of the attention mechanism makes the model converge faster and with higher precision.
引用
收藏
页码:359 / 382
页数:24
相关论文
共 39 条
[1]  
[Anonymous], 2001, INT C ART NEUR NETW
[2]  
[Anonymous], 2016, IEEE T SMART GRID
[3]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, DOI 10.48550/ARXIV.1409.0473]
[4]   Multitask Learning for Fine-Grained Twitter Sentiment Analysis [J].
Balikas, Georgios ;
Moura, Simon ;
Amini, Massih-Reza .
SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, :1005-1008
[5]  
Bengio Y, 2013, INT CONF ACOUST SPEE, P8624, DOI 10.1109/ICASSP.2013.6639349
[6]  
Cao K, 2018, J INF PROCESS SYST, V14, P1508
[7]   Multitask learning [J].
Caruana, R .
MACHINE LEARNING, 1997, 28 (01) :41-75
[8]   Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN [J].
Chen, Tao ;
Xu, Ruifeng ;
He, Yulan ;
Wang, Xuan .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 72 :221-230
[9]  
Cho K., 2014, ARXIV14061078, DOI [DOI 10.3115/V1/D14-1179, 10.3115/v1/D14-1179]
[10]  
Collobert R., 2008, P 25 INT C MACH LEAR, P160, DOI [DOI 10.1145/1390156.1390177.ICML08, DOI 10.1145/1390156.1390177]