MTTLA-DLW: Multi-task TCN-Bi-LSTM transfer learning approach with dynamic loss weights based on feature correlations of the training samples for short-term wind power prediction

被引:1
作者
Song, Jifeng [1 ]
Peng, Xiaosheng [1 ]
Song, Jiajiong [1 ]
Yang, Zimin [1 ]
Wang, Bo [2 ]
Che, Jianfeng [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect & Elect Engn, State Key Lab Adv Electromagnet Engn & Technol, Wuhan 430074, Peoples R China
[2] China Elect Power Res Inst, State Key Lab Operat & Control Renewable Energy &, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
dynamic loss weights; MTL; TCN-Bi-LSTM; transfer learning; NETWORK; MODEL;
D O I
10.1002/we.2909
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Wind power prediction for newly built wind farms is usually faced with the problem of no sufficient historical data. To efficiently extract the useful features from related wind farms, a novel transfer learning method based on temporal convolutional network (TCN)-Bi-long short-term memory (LSTM) with dynamic loss weights is proposed. Firstly, a novel multi-task TCN-Bi-LSTM model is designed to extract common features. The separate TCNs, and common Bi-LSTM layers of the proposed model are designed to extract the temporal features from related wind farms. Secondly, in the pre-training stage, to optimize the training process of the neural networks, a dynamic loss-weighting strategy is proposed for multi-task learning (MTL) to select the most related features, which increase the prediction accuracy by providing a suitable optimization object. Thirdly, the multi-task TCN-Bi-LSTM model is re-trained based on the samples from the target wind farm. Finally, a dataset of seven wind farms was employed to evaluate the efficiency of the proposed MTL structure and the dynamic loss-weighting strategy. The result shows that the root mean squared error of the 12-h short-term prediction can be decreased by 4.19% compared with the traditional single-task learning model, which verifies the validity of the proposed multi-task transfer learning method.
引用
收藏
页码:733 / 744
页数:12
相关论文
共 39 条
[1]   Improved EMD-Based Complex Prediction Model for Wind Power Forecasting [J].
Abedinia, Oveis ;
Lotfi, Mohamed ;
Bagheri, Mehdi ;
Sobhani, Behrouz ;
Shafie-khah, Miadreza ;
Catalao, Joao P. S. .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2020, 11 (04) :2790-2802
[2]   Augmented Convolutional Network for Wind Power Prediction: A New Recurrent Architecture Design With Spatial-Temporal Image Inputs [J].
Cheng, Lilin ;
Zang, Haixiang ;
Xu, Yan ;
Wei, Zhinong ;
Sun, Guoqiang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (10) :6981-6993
[3]   A Multi-Task Matrix Factorized Graph Neural Network for Co-Prediction of Zone-Based and OD-Based Ride-Hailing Demand [J].
Feng, Siyuan ;
Ke, Jintao ;
Yang, Hai ;
Ye, Jieping .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) :5704-5716
[4]   Temporal Convolution-Based Long-Short Term Memory Network With Attention Mechanism for Remaining Useful Life Prediction [J].
Hsu, Chia-Yu ;
Lu, Yi-Wei ;
Yan, Jia-Hong .
IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2022, 35 (02) :220-228
[5]   A transfer learning-based scenario generation method for stochastic optimal scheduling of microgrid with newly-built wind farm [J].
Hu, Jinxing ;
Li, Hongru .
RENEWABLE ENERGY, 2022, 185 :1139-1151
[6]   New Hybrid Deep Neural Architectural Search-Based Ensemble Reinforcement Learning Strategy for Wind Power Forecasting [J].
Jalali, Seyed Mohammad Jafar ;
Osorio, Gerardo J. ;
Ahmadian, Sajad ;
Lotfi, Mohamed ;
Campos, Vasco M. A. ;
Shafie-khah, Miadreza ;
Khosravi, Abbas ;
Catalao, Joao P. S. .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2022, 58 (01) :15-27
[7]   Modeling for chaotic time series based on linear and nonlinear framework: Application to wind speed forecasting [J].
Jiang, Ping ;
Wang, Biao ;
Li, Hongmin ;
Lu, Haiyan .
ENERGY, 2019, 173 :468-482
[8]   Deep Concatenated Residual Network With Bidirectional LSTM for One-Hour-Ahead Wind Power Forecasting [J].
Ko, Min-Seung ;
Lee, Kwangsuk ;
Kim, Jae-Kyeong ;
Hong, Chang Woo ;
Dong, Zhao Yang ;
Hur, Kyeon .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2021, 12 (02) :1321-1335
[9]   A Spatiotemporal Directed Graph Convolution Network for Ultra-Short-Term Wind Power Prediction [J].
Li, Zhuo ;
Ye, Lin ;
Zhao, Yongning ;
Pei, Ming ;
Lu, Peng ;
Li, Yilin ;
Dai, Binhua .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2023, 14 (01) :39-54
[10]   Model-Protected Multi-Task Learning [J].
Liang, Jian ;
Liu, Ziqi ;
Zhou, Jiayu ;
Jiang, Xiaoqian ;
Zhang, Changshui ;
Wang, Fei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) :1002-1019