Predicting and publishing accurate imbalance prices using Monte Carlo Tree Search

被引:0
作者
Pavirani, Fabio [1 ]
Van Gompel, Jonas [1 ]
Madahi, Seyed Soroush Karimi [1 ]
Claessens, Bert [2 ]
Develder, Chris [1 ]
机构
[1] Ghent Univ imec, IDLab, Technol Pk Zwijnaarde 126, B-9052 Ghent, Belgium
[2] BEEBOP, Antwerp, Belgium
关键词
Electrical grid stability; Imbalance prices publication; Reinforcement learning; Deep learning; Monte Carlo Tree Search; Implicit demand response; Forecasting; DEMAND RESPONSE; GO; ALGORITHM; SHOGI; CHESS; GAME;
D O I
10.1016/j.apenergy.2025.125944
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The growing reliance on renewable energy sources, particularly solar and wind, has introduced challenges their uncontrollable production. This complicates maintaining the electrical grid balance, prompting some mission system operators in Western Europe to implement imbalance tariffs that penalize unsustainable deviations. These tariffs create an implicit demand response framework to mitigate grid instability. Yet, challenges limit active participation. In Belgium, for example, imbalance prices are only calculated at of each 15-minute settlement period, creating high risk due to price uncertainty. This risk is further amplified by the inherent volatility of imbalance prices, discouraging participation. Although transmission system ators provide minute-based price predictions, the system imbalance volatility makes accurate price predictions challenging to obtain and requires sophisticated techniques. Moreover, publishing price estimates can participants to adjust their schedules, potentially affecting the system balance and the final price, adding complexity. To address these challenges, we propose a Monte Carlo Tree Search method that publishes imbalance prices while accounting for potential response actions. Our approach models the system dynamics using a neural network forecaster and a cluster of virtual batteries controlled by reinforcement learning Compared to Belgium's current publication method, our technique improves price accuracy by 20.4 ideal conditions and by 12.8 % in more realistic scenarios. This research addresses an unexplored, yet problem, positioning this paper as a pioneering work in analyzing the potential of more advanced imbalance price publishing techniques.
引用
收藏
页数:17
相关论文
共 40 条
[11]  
European Network of Transmission System Operators for Electricity, 2018, Explanatory document to all TSOs' proposal to further specify and harmonise imbalance settlement in accordance with article 52(2) of commission regulation (EU) 2017/2195 of 23 November 2017, establishing a guideline on electricity balancing
[12]  
Ganesh VN, 2023, IEEE Trans Energy Mark Policy Regul, V2, P30
[13]  
Haarnoja T, 2019, Arxiv, DOI arXiv:1812.05905
[14]  
Haarnoja T, 2018, PR MACH LEARN RES, V80
[15]   Dynamic Pricing and Distributed Energy Management for Demand Response [J].
Jia, Liyan ;
Tong, Lang .
IEEE TRANSACTIONS ON SMART GRID, 2016, 7 (02) :1128-1136
[16]   Building HVAC control with reinforcement learning for reduction of energy cost and demand charge [J].
Jiang, Zhanhong ;
Risbeck, Michael J. ;
Ramamurti, Vish ;
Murugesan, Sugumar ;
Amores, Jaume ;
Zhang, Chenlu ;
Lee, Young M. ;
Drees, Kirk H. .
ENERGY AND BUILDINGS, 2021, 239
[17]  
Kim B, 2020, AAAI CONF ARTIF INTE, V34, P9916
[18]   Optimal Control Strategies for Seasonal Thermal Energy Storage Systems With Market Interaction [J].
Lago, Jesus ;
Suryanarayana, Gowri ;
Sogancioglu, Ecem ;
De Schutter, Bart .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2021, 29 (05) :1891-1906
[19]  
Lahariya Manu, 2021, Proceedings of the 2021 IEEE 10th Data Driven Control and Learning Systems Conference (DDCLS), P1044, DOI 10.1109/DDCLS52934.2021.9455657
[20]   Multiagent Reinforcement Learning for Community Energy Management to Mitigate Peak Rebounds Under Renewable Energy Uncertainty [J].
Lai, Bo-Chen ;
Chiu, Wei-Yu ;
Tsai, Yuan-Po .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03) :568-579