Optimal energy management of energy hub: A reinforcement learning approach

被引:14
作者
Yadollahi, Zahra [1 ]
Gharibi, Reza [2 ]
Dashti, Rahman [2 ]
Jahromi, Amin Torabi [1 ]
机构
[1] Persian Gulf Univ, Fac Intelligent Syst Engn & Data Sci, Smart Digital Control Syst Lab, Bushehr 7516913817, Iran
[2] Persian Gulf Univ, Fac Intelligent Syst Engn & Data Sci, Clin Lab Ctr Power Syst & Protect, Bushehr 7516913817, Iran
关键词
Microgrid; Energy hub; Energy management system; Reinforcement learning; Optimization; MULTIOBJECTIVE OPTIMIZATION; COGENERATION SYSTEMS;
D O I
10.1016/j.scs.2024.105179
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Increasing energy demand in today's world emphasizes the importance of optimal scheduling for distributed energy resources to minimize energy costs and greenhouse gas (GHG) emissions. The efficiency of this decision -making process relies on accurate modeling. In this paper, reinforcement learning (RL), an artificial intelligence -based approach, is proposed to optimize the energy management system (EMS) of an energy hub (EH). This EH contains renewable energy resources (RER), a combined heat and power (CHP), and a gas furnace. In order to meet electrical and thermal energy demand, available options such as day -ahead and real-time purchases from the main grid, RERs, and natural gas consumption are managed, with the preference of RERs to minimize GHG emissions and energy costs. With the adaptable RL method, a non-linear model of the CHP operation is constructed, considering the operational costs of the CHP. Furthermore, the natural gas tariff is varied according to the consumption level of the microgrid. Finally, this paper presents an RL-based method for EMS optimization of an EH with day -ahead and real-time scheduling, applied to a 24 -hour case study with linear and nonlinear modeling of the problem and sensitivity analysis of the parameters. Corresponding simulation results show the efficiency of the presented approach.
引用
收藏
页数:12
相关论文
共 50 条
[41]   Multiagent Reinforcement Learning for Community Energy Management to Mitigate Peak Rebounds Under Renewable Energy Uncertainty [J].
Lai, Bo-Chen ;
Chiu, Wei-Yu ;
Tsai, Yuan-Po .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03) :568-579
[42]   Energy management method of integrated energy system based on energy and carbon pricing strategy and reinforcement learning approach [J].
Zhang, Hao ;
Shi, Xuntao ;
Lu, Hai ;
Luo, Enbo ;
Zhang, Yuanlong ;
Li, Kairan ;
Liu, Tong ;
Xu, Min .
Frontiers in Energy Research, 2024, 12
[43]   A Deep Reinforcement Learning Based Approach for Home Energy Management System [J].
Li, Hepeng ;
Wan, Zhiqiang ;
He, Haibo .
2020 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2020,
[44]   A reinforcement learning approach to the design of quantum chains for optimal energy and state transfer [J].
Sgroi, S. ;
Zicari, G. ;
Imparato, A. ;
Paternostro, M. .
MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2025, 6 (01)
[45]   Novel Architecture of Energy Management Systems Based on Deep Reinforcement Learning in Microgrid [J].
Lee, Seongwoo ;
Seon, Joonho ;
Sun, Young Ghyu ;
Kim, Soo Hyun ;
Kyeong, Chanuk ;
Kim, Dong In ;
Kim, Jin Young .
IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) :1646-1658
[46]   Multi-objective Energy Management for We-Energy in Energy Internet using Reinforcement Learning [J].
Sun, Qiuye ;
Wang, Danlu ;
Ma, Dazhong ;
Huang, Bonan .
2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017, :1630-1635
[47]   Optimal energy storage system control using a Markovian degradation model-Reinforcement learning approach [J].
Park, Jaemin ;
Kwon, Taehyeon ;
Sim, Min K. .
JOURNAL OF ENERGY STORAGE, 2023, 71
[48]   Coordinated Optimization of Logistics Electric Fleet and Energy Management System of Constrained Energy Hub [J].
Saklaoui, Ali ;
Poddubnyy, Andrey ;
Nguyen, Phuong ;
Papadimitriou, Christina ;
Dang, Quang-Vinh ;
Hotchandani, Rajiv .
IEEE ACCESS, 2024, 12 :152466-152481
[49]   Energy management of energy hub with renewable energy resources based on GTOA-ACNN approach [J].
Krishnakumar, R. ;
Kumar, U. Arun ;
Gomathy, V. ;
Natraj, N. A. .
ENVIRONMENT DEVELOPMENT AND SUSTAINABILITY, 2025,
[50]   Energy Management Model for HVAC Control Supported by Reinforcement Learning [J].
Macieira, Pedro ;
Gomes, Luis ;
Vale, Zita .
ENERGIES, 2021, 14 (24)