Optimal energy management of energy hub: A reinforcement learning approach

被引:14
作者
Yadollahi, Zahra [1 ]
Gharibi, Reza [2 ]
Dashti, Rahman [2 ]
Jahromi, Amin Torabi [1 ]
机构
[1] Persian Gulf Univ, Fac Intelligent Syst Engn & Data Sci, Smart Digital Control Syst Lab, Bushehr 7516913817, Iran
[2] Persian Gulf Univ, Fac Intelligent Syst Engn & Data Sci, Clin Lab Ctr Power Syst & Protect, Bushehr 7516913817, Iran
关键词
Microgrid; Energy hub; Energy management system; Reinforcement learning; Optimization; MULTIOBJECTIVE OPTIMIZATION; COGENERATION SYSTEMS;
D O I
10.1016/j.scs.2024.105179
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Increasing energy demand in today's world emphasizes the importance of optimal scheduling for distributed energy resources to minimize energy costs and greenhouse gas (GHG) emissions. The efficiency of this decision -making process relies on accurate modeling. In this paper, reinforcement learning (RL), an artificial intelligence -based approach, is proposed to optimize the energy management system (EMS) of an energy hub (EH). This EH contains renewable energy resources (RER), a combined heat and power (CHP), and a gas furnace. In order to meet electrical and thermal energy demand, available options such as day -ahead and real-time purchases from the main grid, RERs, and natural gas consumption are managed, with the preference of RERs to minimize GHG emissions and energy costs. With the adaptable RL method, a non-linear model of the CHP operation is constructed, considering the operational costs of the CHP. Furthermore, the natural gas tariff is varied according to the consumption level of the microgrid. Finally, this paper presents an RL-based method for EMS optimization of an EH with day -ahead and real-time scheduling, applied to a 24 -hour case study with linear and nonlinear modeling of the problem and sensitivity analysis of the parameters. Corresponding simulation results show the efficiency of the presented approach.
引用
收藏
页数:12
相关论文
共 50 条
[21]   Artificial Intelligence Based Smart Energy Community Management: A Reinforcement Learning Approach [J].
Zhou, Suyang ;
Hu, Zijian ;
Gu, Wei ;
Jiang, Meng ;
Zhang, Xiao-Ping .
CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2019, 5 (01) :1-10
[22]   Energy management in residential buildings using energy hub approach [J].
Aamir Raza ;
Tahir Nadeem Malik ;
Muhammad Faisal Nadeem Khan ;
Saqib Ali .
Building Simulation, 2020, 13 :363-386
[23]   Optimal bidding strategy for an energy hub in energy market [J].
Davatgaran, Vahid ;
Saniei, Mohsen ;
Mortazavi, Seyed Saeidollah .
ENERGY, 2018, 148 :482-493
[24]   Reward Function Evaluation in a Reinforcement Learning Approach for Energy Management [J].
Rioual, Yohann ;
Le Moullec, Yannick ;
Laurent, Johann ;
Khan, Muhidul Islam ;
Diguet, Jean-Philippe .
2018 16TH BIENNIAL BALTIC ELECTRONICS CONFERENCE (BEC), 2018,
[25]   Model-free data-driven approach assisted Deep Reinforcement Learning for Optimal Energy Management in MicroGrid [J].
Kaewdornhan, Niphon ;
Chatthaworn, Rongrit .
ENERGY REPORTS, 2023, 9 :850-858
[26]   A new stochastic optimal smart residential energy hub management system for desert environment [J].
Imanloozadeh, Amir ;
Nazififard, Mohammad ;
Sadat, Seyyed Ali .
INTERNATIONAL JOURNAL OF ENERGY RESEARCH, 2021, 45 (13) :18957-18980
[27]   Energy scheduling strategy for energy hubs using reinforcement learning approach [J].
Darbandi, Amin ;
Brockmann, Gerrid ;
Ni, Shixin ;
Kriegel, Martin .
JOURNAL OF BUILDING ENGINEERING, 2024, 98
[28]   Deep reinforcement learning for optimal microgrid energy management with renewable energy and electric vehicle integration [J].
Xiong, Baoyin ;
Zhang, Lili ;
Hu, Yang ;
Fang, Fang ;
Liu, Qingzhi ;
Cheng, Long .
APPLIED SOFT COMPUTING, 2025, 176
[29]   Optimal electrical and thermal energy management of a residential energy hub, integrating demand response and energy storage system [J].
Brahman, Faeze ;
Honarmand, Masoud ;
Jadid, Shahram .
ENERGY AND BUILDINGS, 2015, 90 :65-75
[30]   Applying Reinforcement Learning Method to Optimize an Energy Hub Operation in the Smart Grid [J].
Rayati, M. ;
Sheikhi, A. ;
Ranjbar, A. M. .
2015 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), 2015,