Multi-step ahead wind power forecasting based on dual-attention mechanism

被引:26
作者
Aslam, Muhammad [1 ]
Kim, Jun-Sung [2 ]
Jung, Jaesung [3 ]
机构
[1] Sejong Univ, Dept Artificial Intelligence, Seoul 05006, South Korea
[2] Korea Elect Power Res Inst, Digital Solut Lab, Daejeon 34056, South Korea
[3] Ajou Univ, Dept Elect & Comp Engn, Suwon 16499, Gyeonggi Do, South Korea
关键词
Attention mechanism; Bayesian optimization; Encoder-decoder; LSTM; Renewable energy; Wind power forecasting; NEURAL-NETWORKS; OPTIMIZATION; SPEED; DECOMPOSITION;
D O I
10.1016/j.egyr.2022.11.167
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Accurate forecasting is essential for the economic benefits and efficient operation of intermittent wind power systems. Multi-step ahead wind power forecasting provides multiple benefits in the planning and operation of the power systems. This study proposes a deep learning model based on a dual -attention mechanism for multi-step ahead wind power forecasting. Both the attention mechanisms are applied over the encoder-decoder based sequence-to-sequence model consisting of long short-term memory (LSTM) blocks. The Bayesian optimization algorithm is applied to the proposed model to obtain the optimal combination of hyper-parameters. To evaluate its effectiveness, the proposed model has been compared with the persistence model, and state-of-the-art models such as simple LSTM, LSTM-attention, ensemble model, and neural basis expansion analysis for time series (N-BEATS) model. Furthermore, the performance of the attention mechanism with respect to impactful input features, such as wind speed and air pressure, was analyzed. The forecasting skill score of the proposed model was the highest among all other models in comparison, which indicates the effectiveness of the proposed model. Similarly, the proposed model outperformed the traditional methods in terms of other evaluating criteria, including mean absolute error (MAE), and root mean square error (RMSE) among others, hence, proving its efficacy. The average RMSE score of the proposed model for multi horizon forecasting was 0.04995, whereas that of N-BEATS was 0.0876, ensemble method was 0.1132 and LSTM-attention was around 0.101375. Similarly, the average forecasting skill score of proposed method was 0.6625, whereas that of N-BEATS was 0.3975 and LSTM-attention achieved 0.3775 skill score. (c) 2022 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:239 / 251
页数:13
相关论文
共 51 条
[2]   Review of photovoltaic power forecasting [J].
Antonanzas, J. ;
Osorio, N. ;
Escobar, R. ;
Urraca, R. ;
Martinez-de-Pison, F. J. ;
Antonanzas-Torres, F. .
SOLAR ENERGY, 2016, 136 :78-111
[3]   Two-Stage Attention Over LSTM With Bayesian Optimization for Day-Ahead Solar Power Forecasting [J].
Aslam, Muhammad ;
Lee, Seung-Jae ;
Khang, Sang-Hee ;
Hong, Sugwon .
IEEE ACCESS, 2021, 9 :107387-107398
[4]   AE-LSTM Based Deep Learning Model for Degradation Rate Influenced Energy Estimation of a PV System [J].
Aslam, Muhammad ;
Lee, Jae-Myeong ;
Altaha, Mustafa Raed ;
Lee, Seung-Jae ;
Hong, Sugwon .
ENERGIES, 2020, 13 (17)
[5]   Deep Learning Models for Long-Term Solar Radiation Forecasting Considering Microgrid Installation: A Comparative Study [J].
Aslam, Muhammad ;
Lee, Jae-Myeong ;
Kim, Hyung-Seung ;
Lee, Seung-Jae ;
Hong, Sugwon .
ENERGIES, 2020, 13 (01)
[6]   Forecasting of wind speed using multiple linear regression and artificial neural networks [J].
Barhmi, Soukaina ;
Elfatni, Omkaltoume ;
Belhaj, Ismail .
ENERGY SYSTEMS-OPTIMIZATION MODELING SIMULATION AND ECONOMIC ASPECTS, 2020, 11 (04) :935-946
[7]   Multiple-output modeling for multi-step-ahead time series forecasting [J].
Ben Taieb, Souhaib ;
Sorjamaa, Antti ;
Bontempi, Gianluca .
NEUROCOMPUTING, 2010, 73 (10-12) :1950-1957
[8]   LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT [J].
BENGIO, Y ;
SIMARD, P ;
FRASCONI, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :157-166
[9]   A note on the validity of cross-validation for evaluating autoregressive time series prediction [J].
Bergmeir, Christoph ;
Hyndman, Rob J. ;
Koo, Bonsoo .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2018, 120 :70-83
[10]  
Bergstra James, 2015, Computational Science and Discovery, V8, DOI 10.1088/1749-4699/8/1/014008