Energy scheduling strategy for energy hubs using reinforcement learning approach

被引:0
|
作者
Darbandi, Amin [1 ]
Brockmann, Gerrid [1 ]
Ni, Shixin [1 ]
Kriegel, Martin [1 ]
机构
[1] Tech Univ Berlin, Marchstr 4, D-10587 Berlin, Germany
来源
JOURNAL OF BUILDING ENGINEERING | 2024年 / 98卷
关键词
Energy Management System; Reinforcement learning; Heat demand; Heat dispatch scheduling; Soft Actor-Critic; Proximal Policy Optimization;
D O I
10.1016/j.jobe.2024.111030
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The rapid integration of Renewable Energy Sources (RES) into energy systems is critical for achieving a fossil fuel-free future. However, it also introduces significant challenges, such as increased system complexity and uncertainties in energy output. To overcome these challenges, this paper presents a model-free Deep Reinforcement Learning (DRL) method to energy hub scheduling using state-of-the-art algorithms, specifically Soft Actor-Critic (SAC) and Proximal Policy Optimization (PPO). Breaking away from traditional energy management systems that typically use discrete action spaces, this approach employs a multi-dimensional, continuous action space, providing a more accurate framework for decision-making. Furthermore, the current study adopts a comprehensive perspective by considering not only energy supply and operational costs, but also the often-overlooked impact of emitted emissions in the objective function. The results yield a Pareto space encompassing various criteria, offering a diverse scheduling framework that balances economic feasibility with environmental sustainability. By presenting a range of optimal solutions, this study contributes to the development of more resilient and sustainable energy systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Reinforcement Learning Energy Management Strategy of Tram Based on Condition Identification
    Mo H.
    Yang Z.
    Lin F.
    Wang Y.
    An X.
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2021, 36 (19): : 4170 - 4182
  • [32] An Energy Management Strategy for Traction Substation with ESS Based on Reinforcement Learning
    Luo, Jiaming
    Wei, Xiaoguang
    Gao, Shibin
    Guo, Xiaoran
    Zhong, Tianbao
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION TECHNOLOGIES FOR RAIL TRANSPORTATION, EITRT 2023: ENERGY TRACTION TECHNOLOGY OF RAIL TRANSPORTATION, 2024, 1135 : 11 - 19
  • [33] Reinforcement Learning Based Energy Dispatch Strategy and Control Optimization of Microgrid
    Liu J.-H.
    Ke Z.-M.
    Zhou W.-H.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2020, 43 (01): : 28 - 34
  • [34] Battery energy storage control using a reinforcement learning approach with cyclic time-dependent Markov process
    Abedi, Sara
    Yoon, Sang Won
    Kwon, Soongeol
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2022, 134
  • [35] Reward Function Evaluation in a Reinforcement Learning Approach for Energy Management
    Rioual, Yohann
    Le Moullec, Yannick
    Laurent, Johann
    Khan, Muhidul Islam
    Diguet, Jean-Philippe
    2018 16TH BIENNIAL BALTIC ELECTRONICS CONFERENCE (BEC), 2018,
  • [36] Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks
    Mihaylov, Mihail
    Le Borgne, Yann-Ael
    INTERNATIONAL JOURNAL OF COMMUNICATION NETWORKS AND DISTRIBUTED SYSTEMS, 2012, 9 (3-4) : 207 - 224
  • [37] Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning
    Gao, Guanyu
    Wen, Yonggang
    Tao, Dacheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 10638 - 10652
  • [38] A reinforcement learning based energy optimization approach for household fridges
    Giraldo-Perez, Juan Pablo
    Mejia-Gutierrez, Ricardo
    Aguilar, Jose
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2023, 36
  • [39] Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid
    Foruzan, Elham
    Soh, Leen-Kiat
    Asgarpoor, Sohrab
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (05) : 5749 - 5758
  • [40] Energy Trading Game for Microgrids Using Reinforcement Learning
    Xiao, Xingyu
    Dai, Canhuang
    Li, Yanda
    Zhou, Changhua
    Xiao, Liang
    GAME THEORY FOR NETWORKS (GAMENETS 2017), 2017, 212 : 131 - 140