Toward a Digital Twin: Time Series Prediction Based on a Hybrid Ensemble Empirical Mode Decomposition and BO-LSTM Neural Networks

被引:31
作者
Hu, Weifei [1 ]
He, Yihan [2 ]
Liu, Zhenyu [1 ]
Tan, Jianrong [1 ]
Yang, Ming [3 ]
Chen, Jiancheng [3 ]
机构
[1] Zhejiang Univ, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Sch Mech Engn, Hangzhou 310027, Peoples R China
[3] Xiamen Intretech Inc, 100 Dongfu West Rd, Xiamen 0582841, Fujian, Peoples R China
基金
中国国家自然科学基金;
关键词
digital twin; time series prediction; LSTM neural networks; mode decomposition; Bayesian optimization; wind speed; wave height; artificial intelligence; design optimization; design theory and methodology; machine learning; multidisciplinary design and optimization; wind energy; WIND-SPEED; OPTIMIZATION; DESIGN; LAGS;
D O I
10.1115/1.4048414
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Precise time series prediction serves as an important role in constructing a digital twin (DT). The various internal and external interferences result in highly nonlinear and stochastic time series. Although artificial neural networks (ANNs) are often used to forecast time series because of their strong self-learning and nonlinear fitting capabilities, it is a challenging and time-consuming task to obtain the optimal ANN architecture. This paper proposes a hybrid time series prediction model based on an ensemble empirical mode decomposition (EEMD), long short-term memory (LSTM) neural networks, and Bayesian optimization (BO). To improve the predictability of stochastic and nonstationary time series, the EEMD method is implemented to decompose the original time series into several components (each component is a single-frequency and stationary signal) and a residual signal. The decomposed signals are used to train the neural networks, in which the hyperparameters are fine-tuned by the BO algorithm. The following time series data are predicted by summating all the predictions of the decomposed signals based on the trained neural networks. To evaluate the performance of the proposed EEMD-BO-LSTM neural networks, this paper conducts two case studies (the wind speed prediction and the wave height prediction) and implements a comprehensive comparison between the proposed method and other approaches including the persistence model, autoregressive integrated moving average (ARIMA) model, LSTM neural networks, BO-LSTM neural networks, and EEMD-LSTM neural networks. The results show an improved prediction accuracy using the proposed method by multiple accuracy metrics.
引用
收藏
页数:21
相关论文
共 51 条
  • [1] Adams R.P, P 25 INT C NEUR INF, P2951
  • [2] [Anonymous], 1978, Towards Global Optimization
  • [3] Long short-term memory
    Hochreiter, S
    Schmidhuber, J
    [J]. NEURAL COMPUTATION, 1997, 9 (08) : 1735 - 1780
  • [4] Belcastro C., 2010, AIAA Guidance, Navigation, and Control Conference p, P8004
  • [5] Multiple-output modeling for multi-step-ahead time series forecasting
    Ben Taieb, Souhaib
    Sorjamaa, Antti
    Bontempi, Gianluca
    [J]. NEUROCOMPUTING, 2010, 73 (10-12) : 1950 - 1957
  • [6] LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT
    BENGIO, Y
    SIMARD, P
    FRASCONI, P
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 157 - 166
  • [7] On the use of cross-validation for time series predictor evaluation
    Bergmeir, Christoph
    Benitez, Jose M.
    [J]. INFORMATION SCIENCES, 2012, 191 : 192 - 213
  • [8] Exploration Enhanced Expected Improvement for Bayesian Optimization
    Berk, Julian
    Vu Nguyen
    Gupta, Sunil
    Rana, Santu
    Venkatesh, Svetha
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT II, 2019, 11052 : 621 - 637
  • [9] Boschert S, 2018, Proc. tmce, P209, DOI [10.17560/atp.v60i10.2371, DOI 10.17560/ATP.V60I10.2371]
  • [10] Wind speed forecasting in three different regions of Mexico, using a hybrid ARIMA-ANN model
    Cadenas, Erasmo
    Rivera, Wilfrido
    [J]. RENEWABLE ENERGY, 2010, 35 (12) : 2732 - 2738