Energy scheduling strategy for energy hubs using reinforcement learning approach

被引:0
|
作者
Darbandi, Amin [1 ]
Brockmann, Gerrid [1 ]
Ni, Shixin [1 ]
Kriegel, Martin [1 ]
机构
[1] Tech Univ Berlin, Marchstr 4, D-10587 Berlin, Germany
来源
JOURNAL OF BUILDING ENGINEERING | 2024年 / 98卷
关键词
Energy Management System; Reinforcement learning; Heat demand; Heat dispatch scheduling; Soft Actor-Critic; Proximal Policy Optimization;
D O I
10.1016/j.jobe.2024.111030
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The rapid integration of Renewable Energy Sources (RES) into energy systems is critical for achieving a fossil fuel-free future. However, it also introduces significant challenges, such as increased system complexity and uncertainties in energy output. To overcome these challenges, this paper presents a model-free Deep Reinforcement Learning (DRL) method to energy hub scheduling using state-of-the-art algorithms, specifically Soft Actor-Critic (SAC) and Proximal Policy Optimization (PPO). Breaking away from traditional energy management systems that typically use discrete action spaces, this approach employs a multi-dimensional, continuous action space, providing a more accurate framework for decision-making. Furthermore, the current study adopts a comprehensive perspective by considering not only energy supply and operational costs, but also the often-overlooked impact of emitted emissions in the objective function. The results yield a Pareto space encompassing various criteria, offering a diverse scheduling framework that balances economic feasibility with environmental sustainability. By presenting a range of optimal solutions, this study contributes to the development of more resilient and sustainable energy systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Multi-Energy Scheduling of an Industrial Integrated Energy System by Reinforcement Learning-Based Differential Evolution
    Xu, Zhengwei
    Han, Guangjie
    Liu, Li
    Martinez-Garcia, Miguel
    Wang, Zhijian
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2021, 5 (03): : 1077 - 1090
  • [42] RLS2: An energy efficient reinforcement learning- based sleep scheduling for energy harvesting WBANs
    Mohammadi, Razieh
    Shirmohammadi, Zahra
    COMPUTER NETWORKS, 2023, 229
  • [43] Multi-objective Energy Management for We-Energy in Energy Internet using Reinforcement Learning
    Sun, Qiuye
    Wang, Danlu
    Ma, Dazhong
    Huang, Bonan
    2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017, : 1630 - 1635
  • [44] A Real-Time Intelligent Energy Management Strategy for Hybrid Electric Vehicles Using Reinforcement Learning
    Lee, Woong
    Jeoung, Haeseong
    Park, Dohyun
    Kim, Tacksu
    Lee, Heeyun
    Kim, Namwook
    IEEE ACCESS, 2021, 9 : 72759 - 72768
  • [45] Integrated Velocity Optimization and Energy Management Strategy for Hybrid Electric Vehicle Platoon: A Multiagent Reinforcement Learning Approach
    Zhang, Hailong
    Peng, Jiankun
    Dong, Hanxuan
    Ding, Fan
    Tan, Huachun
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (02): : 2547 - 2561
  • [46] A Long-term Energy Management Strategy for Fuel Cell Electric Vehicles Using Reinforcement Learning
    Zhou, Y. F.
    Huang, L. J.
    Sun, X. X.
    Li, L. H.
    Lian, J.
    FUEL CELLS, 2020, 20 (06) : 753 - 761
  • [47] Optimal planning of hybrid energy storage systems using curtailed renewable energy through deep reinforcement learning
    Kang, Dongju
    Kang, Doeun
    Hwangbo, Sumin
    Niaz, Haider
    Lee, Won Bo
    Liu, J. Jay
    Na, Jonggeol
    ENERGY, 2023, 284
  • [48] Energy Management Strategy based on Reinforcement Learning for Fuel Cell Hybrid Vehicle with A New Reward Function Approach
    Baumler, Antoine
    Benterki, Abdelmoudjib
    2023 IEEE VEHICLE POWER AND PROPULSION CONFERENCE, VPPC, 2023,
  • [49] Optimal Scheduling of Energy Storage System Considering Life-Cycle Degradation Cost Using Reinforcement Learning
    Lee, Wonpoong
    Chae, Myeongseok
    Won, Dongjun
    ENERGIES, 2022, 15 (08)
  • [50] A Multi-Objective Approach for Optimal Energy Management in Smart Home Using the Reinforcement Learning
    Diyan, Muhammad
    Silva, Bhagya Nathali
    Han, Kijun
    SENSORS, 2020, 20 (12) : 1 - 20