Energy scheduling strategy for energy hubs using reinforcement learning approach

被引:0
|
作者
Darbandi, Amin [1 ]
Brockmann, Gerrid [1 ]
Ni, Shixin [1 ]
Kriegel, Martin [1 ]
机构
[1] Tech Univ Berlin, Marchstr 4, D-10587 Berlin, Germany
来源
JOURNAL OF BUILDING ENGINEERING | 2024年 / 98卷
关键词
Energy Management System; Reinforcement learning; Heat demand; Heat dispatch scheduling; Soft Actor-Critic; Proximal Policy Optimization;
D O I
10.1016/j.jobe.2024.111030
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The rapid integration of Renewable Energy Sources (RES) into energy systems is critical for achieving a fossil fuel-free future. However, it also introduces significant challenges, such as increased system complexity and uncertainties in energy output. To overcome these challenges, this paper presents a model-free Deep Reinforcement Learning (DRL) method to energy hub scheduling using state-of-the-art algorithms, specifically Soft Actor-Critic (SAC) and Proximal Policy Optimization (PPO). Breaking away from traditional energy management systems that typically use discrete action spaces, this approach employs a multi-dimensional, continuous action space, providing a more accurate framework for decision-making. Furthermore, the current study adopts a comprehensive perspective by considering not only energy supply and operational costs, but also the often-overlooked impact of emitted emissions in the objective function. The results yield a Pareto space encompassing various criteria, offering a diverse scheduling framework that balances economic feasibility with environmental sustainability. By presenting a range of optimal solutions, this study contributes to the development of more resilient and sustainable energy systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Distributed reinforcement learning energy management approach in multiple residential energy hubs
    Ahrarinouri, Mehdi
    Rastegar, Mohammad
    Karami, Kiana
    Seifi, Ali Reza
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2022, 32
  • [2] A Multi-Agent Deep-Reinforcement-Learning-Based Strategy for Safe Distributed Energy Resource Scheduling in Energy Hubs
    Zhang, Xi
    Wang, Qiong
    Yu, Jie
    Sun, Qinghe
    Hu, Heng
    Liu, Ximu
    ELECTRONICS, 2023, 12 (23)
  • [3] Reinforcement learning-based scheduling strategy for energy storage in microgrid
    Zhou, Kunshu
    Zhou, Kaile
    Yang, Shanlin
    JOURNAL OF ENERGY STORAGE, 2022, 51
  • [4] Optimal scheduling strategy of electricity and thermal energy storage based on soft actor-critic reinforcement learning approach
    Zheng, Yingying
    Wang, Hui
    Wang, Jinglong
    Wang, Zichong
    Zhao, Yongning
    JOURNAL OF ENERGY STORAGE, 2024, 92
  • [5] Optimal energy management of energy hub: A reinforcement learning approach
    Yadollahi, Zahra
    Gharibi, Reza
    Dashti, Rahman
    Jahromi, Amin Torabi
    SUSTAINABLE CITIES AND SOCIETY, 2024, 102
  • [6] Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning
    Kim, Byung-Gook
    Zhang, Yu
    van der Schaar, Mihaela
    Lee, Jang-Won
    IEEE TRANSACTIONS ON SMART GRID, 2016, 7 (05) : 2187 - 2198
  • [7] Intelligent energy management strategy for hybrid electric vehicles using reinforcement learning
    Devaraj T.B.
    Kottoor C.N.R.
    Australian Journal of Electrical and Electronics Engineering, 2024, 21 (01) : 1 - 10
  • [8] Energy Management for Microgrids: a Reinforcement Learning Approach
    Levent, Tanguy
    Preux, Philippe
    Le Pennec, Erwan
    Badosa, Jordi
    Henri, Gonzague
    Bonnassieux, Yvan
    PROCEEDINGS OF 2019 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES EUROPE (ISGT-EUROPE), 2019,
  • [9] An Energy Management Strategy for Hybrid Energy Storage System Based on Reinforcement Learning
    Wang, Yujie
    Li, Wenhuan
    Liu, Zeyan
    Li, Ling
    WORLD ELECTRIC VEHICLE JOURNAL, 2023, 14 (03):
  • [10] Battery Scheduling in a Residential Multi-Carrier Energy System Using Reinforcement Learning
    Mbuwir, Brida V.
    Kaffash, Mahtab
    Deconinck, Geert
    2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CONTROL, AND COMPUTING TECHNOLOGIES FOR SMART GRIDS (SMARTGRIDCOMM), 2018,