Short-term runoff prediction using deep learning multi-dimensional ensemble method

被引:62
作者
Liu, Guanjun [1 ,2 ]
Tang, Zhengyang [1 ,2 ,3 ]
Qin, Hui [1 ,2 ]
Liu, Shuai [1 ,2 ]
Shen, Qin [1 ,2 ]
Qu, Yuhua [1 ,2 ]
Zhou, Jianzhong [1 ,2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Civil & Hydraul Engn, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, Hubei Prov Key Lab Digital Watershed Sci & Techno, Wuhan 430074, Peoples R China
[3] Hubei Key Lab Intelligent Yangtze & Hydroelect Sc, Yichang 443133, Peoples R China
基金
中国国家自然科学基金;
关键词
Ensemble model; Deep learning; Runoff forecasting; Attentional mechanism; Snapshot ensemble; ARTIFICIAL-INTELLIGENCE; GLOBAL OPTIMIZATION; MODEL; SYSTEM; IDENTIFICATION; PERFORMANCE; NETWORK;
D O I
10.1016/j.jhydrol.2022.127762
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Recently, deep learning models have been widely used in water conservancy engineering forecasting problems, due to their excellent ability to deal with the complex interactions between various hydrological factors. However, the existing research mainly focus on model structure adjustment and input feature selection, ignoring the influence of model ensemble on prediction. In this paper, a novel multi-model ensemble method, namely deep learning multi-dimensional ensemble method, is proposed to deal with multi-step runoff prediction problem. The method, which can significantly improve the runoff prediction performance, couples two ensemble techniques with different functional dimensions, namely snapshot ensemble and attention ensemble. Snapshot ensemble technique is used to enhance model generalization capabilities from single-model dimension. While, attention ensemble technique is employed to increase model prediction accuracy from multi-model dimension. Furthermore, a novel data-driven model, called deep learning multi-dimensional ensemble model, is proposed by combining three different deep learning neural networks with deep learning multi-dimensional ensemble method. The proposed model is applied in a real-world case study in the upstream of Yangtze River basin. Three evaluation indicators and ten comparative models are used to test the model performance. The test results not only show the superiority of proposed model over other comparison models, but also prove the effectiveness of the deep learning multi-dimensional ensemble method. The study highlights the power of the ensemble of deep learning model and the promising prospect of our deep learning multi-dimensional ensemble method in hydrological predictions.
引用
收藏
页数:12
相关论文
共 39 条
[1]   AN INTRODUCTION TO THE EUROPEAN HYDROLOGICAL SYSTEM - SYSTEME HYDROLOGIQUE EUROPEEN, SHE .1. HISTORY AND PHILOSOPHY OF A PHYSICALLY-BASED, DISTRIBUTED MODELING SYSTEM [J].
ABBOTT, MB ;
BATHURST, JC ;
CUNGE, JA ;
OCONNELL, PE ;
RASMUSSEN, J .
JOURNAL OF HYDROLOGY, 1986, 87 (1-2) :45-59
[2]   Daily reservoir inflow forecasting using multiscale deep feature learning with hybrid models [J].
Bai, Yun ;
Chen, Zhiqiang ;
Xie, Jingjing ;
Li, Chuan .
JOURNAL OF HYDROLOGY, 2016, 532 :193-206
[3]   TESTING A PHYSICALLY-BASED FLOOD FORECASTING-MODEL (TOPMODEL) FOR 3 UK CATCHMENTS [J].
BEVEN, KJ ;
KIRKBY, MJ ;
SCHOFIELD, N ;
TAGG, AF .
JOURNAL OF HYDROLOGY, 1984, 69 (1-4) :119-143
[4]   The importance of short lag-time in the runoff forecasting model based on long short-term memory [J].
Chen, Xi ;
Huang, Jiaxu ;
Han, Zhen ;
Gao, Hongkai ;
Liu, Min ;
Li, Zhiqiang ;
Liu, Xiaoping ;
Li, Qingli ;
Qi, Honggang ;
Huang, Yonggui .
JOURNAL OF HYDROLOGY, 2020, 589
[5]   EFFECTIVE AND EFFICIENT GLOBAL OPTIMIZATION FOR CONCEPTUAL RAINFALL-RUNOFF MODELS [J].
DUAN, QY ;
SOROOSHIAN, S ;
GUPTA, V .
WATER RESOURCES RESEARCH, 1992, 28 (04) :1015-1031
[6]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[7]   3D Convolutional Neural Networks for Human Action Recognition [J].
Ji, Shuiwang ;
Xu, Wei ;
Yang, Ming ;
Yu, Kai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :221-231
[8]   Deep Convolutional Neural Network for Inverse Problems in Imaging [J].
Jin, Kyong Hwan ;
McCann, Michael T. ;
Froustey, Emmanuel ;
Unser, Michael .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (09) :4509-4522
[9]   AN INTRODUCTION TO NEURAL COMPUTING [J].
KOHONEN, T .
NEURAL NETWORKS, 1988, 1 (01) :3-16
[10]   Rainfall-runoff modelling using Long Short-Term Memory (LSTM) networks [J].
Kratzert, Frederik ;
Klotz, Daniel ;
Brenner, Claire ;
Schulz, Karsten ;
Herrnegger, Mathew .
HYDROLOGY AND EARTH SYSTEM SCIENCES, 2018, 22 (11) :6005-6022