A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism

被引:20
作者
Dai, Zhihui [1 ]
Zhang, Ming [2 ]
Nedjah, Nadia [3 ]
Xu, Dong [4 ]
Ye, Feng [1 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[2] Water Resources Dept Jiangsu Prov, Nanjing 210029, Peoples R China
[3] Univ Estado Rio De Janeiro, Engn Fac, Dept Elect Engn & Telecommun, BR-20550013 Rio De Janeiro, Brazil
[4] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 211100, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
seq2seq model; attention mechanism; LSTM model; hydrological prediction; feature analysis; SHORT-TERM-MEMORY;
D O I
10.3390/w15040670
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the rapid development of IoT, big data and artificial intelligence, the research and application of data-driven hydrological models are increasing. However, when conducting time series analysis, many prediction models are often directly based on the following assumptions: hydrologic time series are normal, homogeneous, smooth and non-trending, which are not always all true. To address the related issues, a solution for short-term hydrological forecasting is proposed. Firstly, a feature test is conducted to verify whether the hydrological time series are normal, homogeneous, smooth and non-trending; secondly, a sequence-to-sequence (seq2seq)-based short-term water level prediction model (LSTM-seq2seq) is proposed to improve the accuracy of hydrological prediction. The model uses a long short-term memory neural network (LSTM) as an encoding layer to encode the historical flow sequence into a context vector, and another LSTM as a decoding layer to decode the context vector in order to predict the target runoff, by superimposing on the attention mechanism, aiming at improving the prediction accuracy. Using the experimental data regarding the water level of the Chu River, the model is compared to other models based on the analysis of normality, smoothness, homogeneity and trending of different water level data. The results show that the prediction accuracy of the proposed model is greater than that of the data set without these characteristics for the data set with normality, smoothness, homogeneity and trend. Flow data at Runcheng, Wuzhi, Baima Temple, Longmen Town, Dongwan, Lu's and Tongguan are used as input data sets to train and evaluate the model. Metrics RMSE and NSE are used to evaluate the prediction accuracy and convergence speed of the model. The results show that the prediction accuracy of LSTM-seq2seq and LSTM-BP models is higher than other models. Furthermore, the convergence process of the LSTM-seq2seq model is the fastest among the compared models.
引用
收藏
页数:15
相关论文
共 36 条
[1]   Development of a coupled wavelet transform and neural network method for flow forecasting of non-perennial rivers in semi-arid watersheds [J].
Adamowski, Jan ;
Sun, Karen .
JOURNAL OF HYDROLOGY, 2010, 390 (1-2) :85-91
[2]   Preliminary streamflow data analyses prior to water resources planning study [J].
Adeloye, AJ ;
Montaseri, M .
HYDROLOGICAL SCIENCES JOURNAL-JOURNAL DES SCIENCES HYDROLOGIQUES, 2002, 47 (05) :679-692
[3]  
Aklilu E.G., 2021, S. Afr. J. Chem. Eng, V37, P12, DOI [10.1016/j.sajce.2021.03.006, DOI 10.1016/J.SAJCE.2021.03.006]
[4]  
Chung JY, 2014, Arxiv, DOI arXiv:1412.3555
[5]  
Dong S.S., 2013, RANDOM MATRICES-THEO, V2, P1
[6]   Prolongation of SMAP to Spatiotemporally Seamless Coverage of Continental US Using a Deep Learning Neural Network [J].
Fang, Kuai ;
Shen, Chaopeng ;
Kifer, Daniel ;
Yang, Xiao .
GEOPHYSICAL RESEARCH LETTERS, 2017, 44 (21) :11030-11039
[7]  
Feng J., 2018, COMPUT MOD, V7, P82
[8]  
Graves A, 2012, STUD COMPUT INTELL, V385, P37
[9]  
Guo S.L., 2015, WATER RESOUR RES, V4, P310, DOI [10.12677/JWRR.2015.44038, DOI 10.12677/JWRR.2015.44038]
[10]  
He X.H., 2022, J RAILW