Powerformer: A temporal-based transformer model for wind power forecasting

被引:27
作者
Mo, Site [1 ]
Wang, Haoxin [1 ]
Li, Bixiong [2 ]
Xue, Zhe [4 ]
Fan, Songhai [3 ]
Liu, Xianggen [4 ]
机构
[1] Sichuan Univ, Coll Elect Engn, Chengdu 610065, Peoples R China
[2] Sichuan Univ, Coll Architecture & Environm, Chengdu 610065, Peoples R China
[3] State Grid Sichuan Elect Power Res Inst, Chengdu 610041, Peoples R China
[4] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
基金
中国国家自然科学基金;
关键词
Renewable energy; Wind power forecasting; Transformer; PREDICTION; ERROR;
D O I
10.1016/j.egyr.2023.12.030
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Wind Power Forecasting has emerged as a critical and dynamic research area in response to the growing demand for renewable energy. The unpredictable and stochastic nature of wind conditions, encompassing factors such as wind speed, wind direction, air temperature, and barometric pressure, poses unique challenges for accurate forecasting of wind power generation. Reliable wind power generation forecasts are essential for optimizing energy grid management, ensuring grid stability, and facilitating the integration of wind energy with existing power systems. To address these challenges, this research introduces Powerformer, a Transformer-based model designed to improve the accuracy of wind power prediction. Powerformer utilizes the infrastructure of the Transformer with innovative modifications to address the complexity of wind power prediction, enhancing temporal feature extraction capabilities while reducing complexity. The research in this study includes a comprehensive set of experiments, revealing that Powerformer achieves superior results among all models. Furthermore, the model exhibits stronger robustness, as confirmed through a series of ablation experiments validating the reasonableness of the model design.
引用
收藏
页码:736 / 744
页数:9
相关论文
共 35 条
[1]   MEAN SQUARE ERROR OF PREDICTION AS A CRITERION FOR SELECTING VARIABLES [J].
ALLEN, DM .
TECHNOMETRICS, 1971, 13 (03) :469-&
[2]  
Awad M., 2015, EFFICIENT LEARNING M, P67
[3]  
Beltagy I, 2020, Arxiv, DOI arXiv:2004.05150
[4]   Generalized autoregressive moving average models [J].
Benjamin, MA ;
Rigby, RA ;
Stasinopoulos, DM .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2003, 98 (461) :214-223
[5]   Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function [J].
Bommidi, Bala Saibabu ;
Teeparthi, Kiran ;
Kosana, Vishalteja .
ENERGY, 2023, 265
[6]   Back Propagation neural networks [J].
Buscema, M .
SUBSTANCE USE & MISUSE, 1998, 33 (02) :233-270
[7]   Pre-Trained Image Processing Transformer [J].
Chen, Hanting ;
Wang, Yunhe ;
Guo, Tianyu ;
Xu, Chang ;
Deng, Yiping ;
Liu, Zhenhua ;
Ma, Siwei ;
Xu, Chunjing ;
Xu, Chao ;
Gao, Wen .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12294-12305
[8]  
Chen T., 2015, R PACKAGE VERSION 04, V1
[9]   Mean Absolute Percentage Error for regression models [J].
de Myttenaere, Arnaud ;
Golden, Boris ;
Le Grand, Benedicte ;
Rossi, Fabrice .
NEUROCOMPUTING, 2016, 192 :38-48
[10]  
Dey R, 2017, MIDWEST SYMP CIRCUIT, P1597, DOI 10.1109/MWSCAS.2017.8053243