Energy scheduling strategy for energy hubs using reinforcement learning approach

被引:0
|
作者
Darbandi, Amin [1 ]
Brockmann, Gerrid [1 ]
Ni, Shixin [1 ]
Kriegel, Martin [1 ]
机构
[1] Tech Univ Berlin, Marchstr 4, D-10587 Berlin, Germany
来源
JOURNAL OF BUILDING ENGINEERING | 2024年 / 98卷
关键词
Energy Management System; Reinforcement learning; Heat demand; Heat dispatch scheduling; Soft Actor-Critic; Proximal Policy Optimization;
D O I
10.1016/j.jobe.2024.111030
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The rapid integration of Renewable Energy Sources (RES) into energy systems is critical for achieving a fossil fuel-free future. However, it also introduces significant challenges, such as increased system complexity and uncertainties in energy output. To overcome these challenges, this paper presents a model-free Deep Reinforcement Learning (DRL) method to energy hub scheduling using state-of-the-art algorithms, specifically Soft Actor-Critic (SAC) and Proximal Policy Optimization (PPO). Breaking away from traditional energy management systems that typically use discrete action spaces, this approach employs a multi-dimensional, continuous action space, providing a more accurate framework for decision-making. Furthermore, the current study adopts a comprehensive perspective by considering not only energy supply and operational costs, but also the often-overlooked impact of emitted emissions in the objective function. The results yield a Pareto space encompassing various criteria, offering a diverse scheduling framework that balances economic feasibility with environmental sustainability. By presenting a range of optimal solutions, this study contributes to the development of more resilient and sustainable energy systems.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Reinforcement-Learning Approach Guidelines for Energy Management
    Rioual, Yohann
    Laurent, Johann
    Diguet, Jean-Philippe
    JOURNAL OF LOW POWER ELECTRONICS, 2019, 15 (03) : 283 - 293
  • [22] Optimal Energy Scheduling of Flexible Industrial Prosumers via Reinforcement Learning
    van den Bovenkamp, Nick
    Giraldo, Juan S.
    Duque, Edgar Mauricio Salazar
    Vergara, Pedro P.
    Konstantinou, Charalambos
    Palensky, Peter
    2023 IEEE BELGRADE POWERTECH, 2023,
  • [23] Joint Energy and Workload Scheduling for Fog-Assisted Multimicrogrid Systems: A Deep Reinforcement Learning Approach
    Zhang, Tingjun
    Yue, Dong
    Yu, Liang
    Dou, Chunxia
    Xie, Xiangpeng
    IEEE SYSTEMS JOURNAL, 2023, 17 (01): : 164 - 175
  • [24] Pattern Driven Dynamic Scheduling Approach using Reinforcement Learning
    Wei Yingzi
    Jiang Xinli
    Hao Pingbo
    Gu Kanfeng
    2009 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS ( ICAL 2009), VOLS 1-3, 2009, : 514 - +
  • [25] Energy Management System for a Hybrid Electric Vehicle Using Reinforcement Learning
    Chen, Syuan-Yi
    Lo, Hsiang-Yu
    Tsao, Tung-Yao
    Lai, I-Wei
    IEEE ISPCE-ASIA 2021: IEEE INTERNATIONAL SYMPOSIUM ON PRODUCT COMPLIANCE ENGINEERING - ASIA, 2021,
  • [26] Energy Management System for a Hybrid Electric Vehicle Using Reinforcement Learning
    Chen, Syuan-Yi
    Lo, Hsiang-Yu
    Tsao, Tung-Yao
    Lai, I-Wei
    IEEE ISPCE-ASIA 2021: IEEE INTERNATIONAL SYMPOSIUM ON PRODUCT COMPLIANCE ENGINEERING - ASIA, 2021,
  • [27] Indirect Multi-Energy Transactions of Energy Internet With Deep Reinforcement Learning Approach
    Yang, Lingxiao
    Sun, Qiuye
    Zhang, Ning
    Li, Yushuai
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (05) : 4067 - 4077
  • [28] Delay and energy aware task scheduling mechanism for fog-enabled IoT applications: A reinforcement learning approach
    Raju, Mekala Ratna
    Mothku, Sai Krishna
    COMPUTER NETWORKS, 2023, 224
  • [29] Multipath TCP Meets Reinforcement Learning: A Novel Energy-Efficient Scheduling Approach in Heterogeneous Wireless Networks
    Dong, Pingping
    Shen, Rongcheng
    Wang, Qian
    Zhang, Dian
    Li, Yajing
    Zuo, Yuning
    Yang, Wenjun
    Zhang, Lianming
    IEEE WIRELESS COMMUNICATIONS, 2023, 30 (02) : 138 - 146
  • [30] Restoration-Aware Sleep Scheduling Framework in Energy Harvesting Internet of Things: A Deep Reinforcement Learning Approach
    Ko, Haneul
    Choi, Hongrok
    Pack, Sangheon
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2025, 10 (01): : 190 - 198