A Hybrid Framework for Multivariate Time Series Forecasting of Daily Urban Water Demand Using Attention-Based Convolutional Neural Network and Long Short-Term Memory Network

被引:23
作者
Zhou, Shengwen [1 ,2 ]
Guo, Shunsheng [1 ,2 ]
Du, Baigang [1 ,2 ]
Huang, Shuo [1 ,2 ]
Guo, Jun [1 ,2 ]
机构
[1] Wuhan Univ Technol, Sch Mech & Elect Engn, Wuhan 430070, Peoples R China
[2] Hubei Digital Mfg Key Lab, Wuhan 430070, Peoples R China
基金
中国国家自然科学基金;
关键词
water demand forecasting; multivariate time series; convolutional neural network; long short-term memory; attention mechanism; encoder-decoder network; MODEL;
D O I
10.3390/su141711086
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Urban water demand forecasting is beneficial for reducing the waste of water resources and enhancing environmental protection in sustainable water management. However, it is a challenging task to accurately predict water demand affected by a range of factors with nonlinear and uncertainty temporal patterns. This paper proposes a new hybrid framework for urban daily water demand with multiple variables, called the attention-based CNN-LSTM model, which combines convolutional neural network (CNN), long short-term memory (LSTM), attention mechanism (AM), and encoder-decoder network. CNN layers are used to learn the representation and correlation between multivariate variables. LSTM layers are utilized as the building blocks of the encoder-decoder network to capture temporal characteristics from the input sequence, while AM is introduced to the encoder-decoder network to assign corresponding attention according to the importance of water demand multivariable time series at different times. The new hybrid framework considers correlation between multiple variables and neglects irrelevant data points, which helps to improve the prediction accuracy of multivariable time series. The proposed model is contrasted with the LSTM model, the CNN-LSTM model, and the attention-based LSTM to predict the daily water demand time series in Suzhou, China. The results show that the hybrid model achieves higher prediction performance with the smallest mean absolute error (MAE), root mean squared error (RMSE), and mean absolute percentage error (MAPE), and largest correlation coefficient (R-2).
引用
收藏
页数:22
相关论文
共 40 条
[1]   An optimized model using LSTM network for demand forecasting [J].
Abbasimehr, Hossein ;
Shabani, Mostafa ;
Yousefi, Mohsen .
COMPUTERS & INDUSTRIAL ENGINEERING, 2020, 143
[2]   Sentiment Analysis of Fast Food Companies With Deep Learning Models [J].
Abdalla, Ghazi ;
Ozyurt, Fatih .
COMPUTER JOURNAL, 2021, 64 (03) :383-390
[3]   Accurate photovoltaic power forecasting models using deep LSTM-RNN [J].
Abdel-Nasser, Mohamed ;
Mahmoud, Karar .
NEURAL COMPUTING & APPLICATIONS, 2019, 31 (07) :2727-2740
[4]   A Bias and Variance Analysis for Multistep-Ahead Time Series Forecasting [J].
Ben Taieb, Souhaib ;
Atiya, Amir F. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) :62-76
[5]   Multi-Sequence LSTM-RNN Deep Learning and Metaheuristics for Electric Load Forecasting [J].
Bouktif, Salah ;
Fiaz, Ali ;
Ouni, Ali ;
Serhani, Mohamed Adel .
ENERGIES, 2020, 13 (02)
[6]   Interpretable spatio-temporal attention LSTM model for flood forecasting [J].
Ding, Yukai ;
Zhu, Yuelong ;
Feng, Jun ;
Zhang, Pengcheng ;
Cheng, Zirun .
NEUROCOMPUTING, 2020, 403 :348-359
[7]   Deep learning with long short-term memory neural networks combining wavelet transform and principal component analysis for daily urban water demand forecasting [J].
Du, Baigang ;
Zhou, Qiliang ;
Guo, Jun ;
Guo, Shunsheng ;
Wang, Lei .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 171
[8]   Multivariate time series forecasting via attention-based encoder-decoder framework [J].
Du, Shengdong ;
Li, Tianrui ;
Yang, Yan ;
Horng, Shi-Jinn .
NEUROCOMPUTING, 2020, 388 (388) :269-279
[9]   A reliable linear method for modeling lake level fluctuations [J].
Ebtehaj, Isa ;
Bonakdari, Hossein ;
Gharabaghi, Bahram .
JOURNAL OF HYDROLOGY, 2019, 570 :236-250
[10]   A Deep Learning Model for Smart Manufacturing Using Convolutional LSTM Neural Network Autoencoders [J].
Essien, Aniekan ;
Giannetti, Cinzia .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (09) :6069-6078