Reinforcement Learning-Driven Decision-Making in Deregulated Electricity Markets Involving Greedy Agent-Based Participants

被引:0
作者
Arvanitidis, Athanasios Ioannis [1 ]
Alamaniotis, Miltiadis [1 ]
机构
[1] Univ Texas San Antonio, Elect Comp Engn, San Antonio, TX 78249 USA
来源
2024 IEEE TEXAS POWER AND ENERGY CONFERENCE, TPEC | 2024年
关键词
smart grids; autonomous economic dispatch; reinforcement learning; greedy reward system; OPERATION; SYSTEMS;
D O I
10.1109/TPEC60005.2024.10472267
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The transition from conventional power systems to smart grids has established the foundation for the integration of advanced artificial intelligence algorithms aimed at addressing optimization challenges within deregulated electricity markets. This paper explores the dynamic intersection of deregulated energy markets, economic dispatch principles, and the integration of sophisticated Reinforcement Learning algorithms. Specifically, the role of the Q-Learning algorithm in shaping the decisionmaking processes of a generation company, with the objective of maximizing revenue in a competitive environment, is studied. Additionally, a novel greedy reward system has been embedded to enhance the learning capabilities of an agent, guiding it towards the formulation of optimal power generation decisions. The numerical results of our paper highlight the importance of implementing reinforcement learning approaches in power systems and emphasize the significance of reward engineering in Reinforcement Learning research related to revenue maximization within the evolving landscape of deregulated energy markets.
引用
收藏
页码:79 / 84
页数:6
相关论文
共 14 条
  • [1] Economic optimal operation of Community Energy Storage systems in competitive energy markets
    Arghandeh, Reza
    Woyak, Jeremy
    Onen, Ahmet
    Jung, Jaesung
    Broadwater, Robert P.
    [J]. APPLIED ENERGY, 2014, 135 : 71 - 80
  • [2] Optimized Data-Driven Models for Short-Term Electricity Price Forecasting Based on Signal Decomposition and Clustering Techniques
    Arvanitidis, Athanasios Ioannis
    Bargiotas, Dimitrios
    Kontogiannis, Dimitrios
    Fevgas, Athanasios
    Alamaniotis, Miltiadis
    [J]. ENERGIES, 2022, 15 (21)
  • [3] Wind and Energy Markets: A Case Study of Texas
    Baldick, Ross
    [J]. IEEE SYSTEMS JOURNAL, 2012, 6 (01): : 27 - 34
  • [4] The Exploration-Exploitation Dilemma: A Multidisciplinary Framework
    Berger-Tal, Oded
    Nathan, Jonathan
    Meron, Ehud
    Saltz, David
    [J]. PLOS ONE, 2014, 9 (04):
  • [5] Dewey D, 2014, 2014 AAAI SPRING S S
  • [6] Eschmann J., 2021, Reinf. Learn. Algorithms Analysis Appl, P25, DOI [DOI 10.1007/978-3-030-41188-63, 10.1007/978-3-030-41188-63]
  • [7] Reinforcement learning: A survey
    Kaelbling, LP
    Littman, ML
    Moore, AW
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 1996, 4 : 237 - 285
  • [8] Error Compensation Enhanced Day-Ahead Electricity Price Forecasting
    Kontogiannis, Dimitrios
    Bargiotas, Dimitrios
    Daskalopulu, Aspassia
    Arvanitidis, Athanasios Ioannis
    Tsoukalas, Lefteri H.
    [J]. ENERGIES, 2022, 15 (04)
  • [9] From electricity smart grids to smart energy systems - A market operation based approach and understanding
    Lund, Henrik
    Andersen, Anders N.
    Ostergaard, Poul Alberg
    Mathiesen, Brian Vad
    Connolly, David
    [J]. ENERGY, 2012, 42 (01) : 96 - 102
  • [10] Towers M., 2023, Gymnasium