Integrating domain knowledge into transformer for short-term wind power forecasting

被引:8
作者
Cheng, Junhao [1 ]
Luo, Xing [2 ]
Jin, Zhi [1 ,3 ]
机构
[1] Shenzhen Campus Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen 518107, Guangdong, Peoples R China
[2] Peng Cheng Lab, Dept Frontier Res, Shenzhen 518055, Peoples R China
[3] Guangdong Prov Key Lab Fire Sci & Technol, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Wind power forecasting; Deep learning; Domain knowledge; Domain-knowledge integrated transformer; model; MODE DECOMPOSITION; PREDICTION;
D O I
10.1016/j.energy.2024.133511
中图分类号
O414.1 [热力学];
学科分类号
摘要
Wind energy is an environmentally friendly source of energy and serves as an efficient supplement to conventional energy resources. Accurate wind power forecasting is crucial for effective decision-making in the daily operation of wind power plants. However, due to the heavy dependence on weather conditions, the variability and uncertainty associated with weather pose significant challenges to wind power forecasting. In this study, we propose a domain-knowledge integrated Transformer (DKFormer) model for short-term wind power forecasting. The proposed model integrates domain knowledge of wind power generation through three portable modules that play essential roles in data pre-processing, model training, and forecasting stages respectively. Additionally, by constructing boundary constraints that simultaneously utilize the data of both measured wind power and numerical weather prediction (NWP), the DKFormer model further reduces errors in multi-step wind power forecasting and improves overall forecast performance, particularly when input wind speed data exhibits dramatic variations. Furthermore, transfer learning techniques are employed to enhance the forecast capability of the DKFormer model using limited training data. Real-life datasets are used to evaluate the performance of the proposed DKFormer, demonstrating its superiority over conventional statistical models and DL models in short-term wind forecasting. Specifically, in day-ahead wind power forecasting experiments, our proposed DKFormer model achieves a 22.0% reduction in mean absolute error (MAE) while also exhibiting improved forecast stability compared to the conventional Transformer model.
引用
收藏
页数:15
相关论文
共 48 条
[1]   Improved EMD-Based Complex Prediction Model for Wind Power Forecasting [J].
Abedinia, Oveis ;
Lotfi, Mohamed ;
Bagheri, Mehdi ;
Sobhani, Behrouz ;
Shafie-khah, Miadreza ;
Catalao, Joao P. S. .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2020, 11 (04) :2790-2802
[2]  
Aggarwal S., 2013, Int. J. Energy, V3, P1
[3]  
Bp B., 2023, BP educational service
[4]   Wind Power Forecasts Using Gaussian Processes and Numerical Weather Prediction [J].
Chen, Niya ;
Qian, Zheng ;
Nabney, Ian T. ;
Meng, Xiaofeng .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2014, 29 (02) :656-665
[5]   A gated recurrent unit neural networks based wind speed error correction model for short-term wind power forecasting [J].
Ding, Min ;
Zhou, Hao ;
Xie, Hua ;
Wu, Min ;
Nakanishi, Yosuke ;
Yokoyama, Ryuichi .
NEUROCOMPUTING, 2019, 365 :54-61
[6]  
Dosovitskiy A., 2021, 9 INT C LEARN REPR I
[7]   ARMA based approaches for forecasting the tuple of wind speed and direction [J].
Erdem, Ergin ;
Shi, Jing .
APPLIED ENERGY, 2011, 88 (04) :1405-1414
[8]   An adaptive deep-learning load forecasting framework by integrating transformer and domain knowledge [J].
Gao, Jiaxin ;
Chen, Yuntian ;
Hu, Wenbo ;
Zhang, Dongxiao .
ADVANCES IN APPLIED ENERGY, 2023, 10
[9]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[10]  
Hansen M O L, 2015, Aerodynamics of wind turbines