Short-term power load forecasting based on Seq2Seq model integrating Bayesian optimization, temporal convolutional network and attention

被引:11
作者
Dai, Yeming [1 ]
Yu, Weijie [1 ]
机构
[1] Qingdao Univ, Sch Business, Qingdao 200071, Peoples R China
基金
中国国家自然科学基金;
关键词
Power load forecasting; Successive Variational Mode Decomposition; Attention mechanism; Sequence to Sequence; Temporal Convolutional Network;
D O I
10.1016/j.asoc.2024.112248
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Power load forecasting is of great significance to the electricity management. However, extant research is insufficient in comprehensively combining data processing and further optimization of existing prediction models. Therefore, this paper propose an improved power load prediction methods from two aspects: data processing and optimization of Sequence to Sequence (Seq2Seq) model. Firstly, in the data processing, Extreme Gradient Boosting (XGBoost) is adopted to eliminate the redundant features for feature extraction. Meanwhile, Successive Variational Mode Decomposition (SVMD) is employed to solve the unsteadiness and nonlinearities present in electricity data during the decomposition process. Secondly, the Seq2Seq model is selected and improved with a variety of machine learning methods. Specifically, input data features are extracted using Convolutional Neural Networks (CNN), enhancing the decoder's focus on vital information with the Attention mechanism (AM). Temporal Convolutional Network (TCN) serves as both the encoder and decoder of Seq2Seq, with further optimization of the model parameters through the Bayesian Optimization (BO) algorithm. Finally, the cases of two real power market datasets in Switzerland and Singapore illustrate the efficiency and superiority of proposed hybrid forecasting method. Through a comprehensive comparison and analysis with the other six models and four commonly used evaluation metrics, it is evident that the proposed method excels in performance, attaining the highest level of prediction accuracy, with the highest accuracy rate of 95.83 %. Consequently, it exhibits significant practical utility in the realm of power load forecasting.
引用
收藏
页数:15
相关论文
共 44 条
[1]   Explaining individual predictions when features are dependent: More accurate approximations to Shapley values [J].
Aas, Kjersti ;
Jullum, Martin ;
Loland, Anders .
ARTIFICIAL INTELLIGENCE, 2021, 298
[2]   Hybrid machine learning algorithms to predict condensate viscosity in the near wellbore regions of gas condensate reservoirs [J].
Abad, Abouzar Rajabi Behesht ;
Mousavi, Seyedmohammadvahid ;
Mohamadian, Nima ;
Wood, David A. ;
Ghorbani, Hamzeh ;
Davoodi, Shadfar ;
Alvar, Mehdi Ahmadi ;
Shahbazi, Khalil .
JOURNAL OF NATURAL GAS SCIENCE AND ENGINEERING, 2021, 95
[3]   A comprehensive study of renewable energy sources: Classifications, challenges and suggestions [J].
Ang, Tze-Zhang ;
Salem, Mohamed ;
Kamarol, Mohamad ;
Das, Himadry Shekhar ;
Nazari, Mohammad Alhuyi ;
Prabaharan, Natarajan .
ENERGY STRATEGY REVIEWS, 2022, 43
[4]  
Bai SJ, 2018, Arxiv, DOI [arXiv:1803.01271, DOI 10.48550/ARXIV.1803.01271]
[5]   DNN-DTIs: Improved drug-target interactions prediction using XGBoost feature selection and deep neural network [J].
Chen, Cheng ;
Shi, Han ;
Jiang, Zhiwen ;
Salhi, Adil ;
Chen, Ruixin ;
Cui, Xuefeng ;
Yu, Bin .
COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 136
[6]   Optimized Seq2Seq model based on multiple methods for short-term power load forecasting [J].
Dai, Yeming ;
Yang, Xinyu ;
Leng, Mingming .
APPLIED SOFT COMPUTING, 2023, 142
[7]   Improving the Bi-LSTM model with XGBoost and attention mechanism: A combined approach for short-term power load prediction [J].
Dai, Yeming ;
Zhou, Qiong ;
Leng, Mingming ;
Yang, Xinyu ;
Wang, Yanxin .
APPLIED SOFT COMPUTING, 2022, 130
[8]   Forecasting power load: A hybrid forecasting method with intelligent data processing and optimized artificial intelligence [J].
Dai, Yeming ;
Yang, Xinyu ;
Leng, Mingming .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2022, 182
[9]   A hybrid approach for Bangla sign language recognition using deep transfer learning model with random forest classifier [J].
Das, Sunanda ;
Imtiaz, Md. Samir ;
Neom, Nieb Hasan ;
Siddique, Nazmul ;
Wang, Hui .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
[10]   Optimization of Short-Term Forecast of Electric Power Demand in the city of Yaound?e-Cameroon by a hybrid model based on the combination of neural networks and econometric methods from a designed energy optimization algorithm [J].
Dieudonne, Nzoko Tayo ;
Armel, Talla Konchou Franck ;
Hermann, Djeudjo Temene ;
Vidal, Aloyem Kaze Claude ;
Rene, Tchinda .
TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2023, 187