Accurate water quality prediction with attention-based bidirectional LSTM and encoder-decoder

被引:30
作者
Bi, Jing [1 ]
Chen, Zexian [1 ]
Yuan, Haitao [2 ]
Zhang, Jia [3 ]
机构
[1] Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Southern Methodist Univ, Lyle Sch Engn, Dept Comp Sci, Dallas, TX 75205 USA
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Water quality prediction; Variational mode decomposition; BiLSTM; Attention mechanisms; Encoder-decoder; NEURAL-NETWORK; TERM; ENERGY; SERIES; MODEL;
D O I
10.1016/j.eswa.2023.121807
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate prediction of water quality indicators can effectively predict sudden water pollution events and reveal them to water users for reducing the impact of water quality pollution. Neural networks, e.g., Long Short-Term Memory (LSTM) and encoder-decoder, have been widely used to predict time series data. However, as the water quality data increases, it becomes unstable and highly nonlinear, and therefore, its accurate prediction becomes a big challenge. To solve it, this work proposes a hybrid prediction method called VBAED to predict the water quality time series. VBAED combines Variational mode decomposition (VMD), a Bidirectional input Attention mechanism, an Encoder with bidirectional LSTM (BiLSTM), and a Decoder with a bidirectional temporal attention mechanism and BiLSTM. The definition of VBAED is an Encoder-Decoder model that uses VMD as mode decomposition, combining BiLSTM with a bidirectional attention mechanism. Specifically, VBAED first adopts VMD to decompose historical data of a predicted factor, and its decomposed results are adopted as the input along with other features. Then, a bidirectional input attention mechanism is adopted to add weights to input features from both directions. VBAED adopts BiLSTM as an encoder to extract hidden features from input features. Finally, the predicted result is obtained by a BiLSTM decoder with a bidirectional temporal attention mechanism. Real-life data-based experiments demonstrate that VBAED obtains the best prediction results compared with other widely used methods.
引用
收藏
页数:10
相关论文
共 50 条
[1]   Hourly Solar Irradiance Prediction Based on Support Vector Machine and Its Error Analysis [J].
Bae, Kuk Yeol ;
Jang, Han Seung ;
Sung, Dan Keun .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2017, 32 (02) :935-945
[2]   LSTM-MSNet: Leveraging Forecasts on Sets of Related Time Series With Multiple Seasonal Patterns [J].
Bandara, Kasun ;
Bergmeir, Christoph ;
Hewamalage, Hansika .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (04) :1586-1599
[3]  
Bi J., 2022, 2022 IEEE INT C SYST, P6
[4]  
Bi J., 2020, P 2020 IEEE INT C NE, P1
[5]   Large-scale water quality prediction with integrated deep neural network [J].
Bi, Jing ;
Lin, Yongze ;
Dong, Quanxi ;
Yuan, Haitao ;
Zhou, MengChu .
INFORMATION SCIENCES, 2021, 571 (571) :191-205
[6]  
Box George EP, 1970, Journal of the American statistical Association, V65, P1509
[7]   Multistage Wind-Electric Power Forecast by Using a Combination of Advanced Statistical Methods [J].
Buhan, Serkan ;
Cadirci, Isik .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2015, 11 (05) :1231-1242
[8]   Modeling water quality in an urban river using hydrological factors - Data driven approaches [J].
Chang, Fi-John ;
Tsai, Yu-Hsuan ;
Chen, Pin-An ;
Coynel, Alexandra ;
Vachaud, Georges .
JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2015, 151 :87-96
[9]   Using an ARIMA-GARCH Modeling Approach to Improve Subway Short-Term Ridership Forecasting Accounting for Dynamic Volatility [J].
Ding, Chuan ;
Duan, Jinxiao ;
Zhang, Yanru ;
Wu, Xinkai ;
Yu, Guizhen .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2018, 19 (04) :1054-1064
[10]  
Dong QX, 2019, IEEE SYS MAN CYBERN, P3537, DOI [10.1109/SMC.2019.8914404, 10.1109/smc.2019.8914404]