A multi-agent deep reinforcement learning approach enabled distributed energy management schedule for the coordinate control of multi-energy hub with gas, electricity, and freshwater

被引:45
作者
Zhang, Guozhou [1 ]
Hu, Weihao [1 ]
Cao, Di [1 ]
Zhang, Zhenyuan [1 ]
Huang, Qi [2 ]
Chen, Zhe [3 ]
Blaabjerg, Frede [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Sichuan Prov Key Lab Power Syst Wide Area Measure, Chengdu, Peoples R China
[2] Chengdu Univ Technol, Chengdu, Peoples R China
[3] Aalborg Univ, Dept Energy Technol, Pontoppidanstr 111, Aalborg, Denmark
关键词
Multi-energy hub; Cost reduction; Distributed energy scheduling policy; Attention mechanism; Multi-agent deep reinforcement learning; ROBUST OPTIMIZATION; OPTIMAL OPERATION; DEMAND RESPONSE; SYSTEM; RESOURCES; FRAMEWORK; NETWORK; STORAGE; MODEL; STATE;
D O I
10.1016/j.enconman.2022.115340
中图分类号
O414.1 [热力学];
学科分类号
摘要
In recent years, due to the deeply concerns on environment protection, the production, transformation and utilization of the energy sources with a more efficient and various way has become an important research topic. Under this background, this paper designs a renewable energy powered multi-energy hub system with gas, electricity, and freshwater sub-system. To enhance the flexibility and reduce the total cost of such system, the energy management of the multi-energy hub is formed as multi-agent cooperative control, and several targets, including operational costs, environment cost, and maintenance cost are considered along with the constraints. Subsequently, a novel attention mechanism-based multi-agent deep reinforcement learning algorithm is applied, where multi-agents are centrally trained to obtain the coordinate energy management strategy while being executed in a decentralized manner to provide the dispatch instruction for each energy hub with only local states. Finally, the effectiveness of the proposed method is investigated in the study system and the simulation results show that it can reduce the total cost by up to 7.28% compared with the other benchmark methods.
引用
收藏
页数:16
相关论文
共 45 条
[1]   Optimal design of a grid-connected desalination plant powered by renewable energy resources using a hybrid PSO-GWO approach [J].
Abdelshafy, Alaaeldin M. ;
Hassan, Hamdy ;
Jurasz, Jakub .
ENERGY CONVERSION AND MANAGEMENT, 2018, 173 :331-347
[2]   Numerical prediction of off-design performance for a Power-to-Gas system coupled with renewables [J].
Ancona, M. A. ;
Bianchi, M. ;
Branchini, L. ;
Catena, F. ;
De Pascale, A. ;
Melino, F. ;
Peretto, A. .
ENERGY CONVERSION AND MANAGEMENT, 2020, 210
[3]   A general model for energy hub economic dispatch [J].
Beigvand, Soheil Derafshi ;
Abdi, Hamdi ;
La Scala, Massimo .
APPLIED ENERGY, 2017, 190 :1090-1111
[4]   Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Zhang, Guozhou ;
Zhang, Bin ;
Liu, Zhou ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) :1029-1042
[5]   Development and analysis of a polygenerational smart energy hub for sustainable communities [J].
Chehade, Ghassan ;
Dincer, Ibrahim .
ENERGY CONVERSION AND MANAGEMENT, 2020, 226
[6]   Gaussian Process Kernel Transfer Enabled Method for Electric Machines Intelligent Faults Detection With Limited Samples [J].
Chen, Jianjun ;
Hu, Weihao ;
Cao, Di ;
Zhang, Man ;
Huang, Qi ;
Chen, Zhe ;
Blaabjerg, Frede .
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2021, 36 (04) :3481-3490
[7]   Novel Data-Driven Approach Based on Capsule Network for Intelligent Multi-Fault Detection in Electric Motors [J].
Chen, Jianjun ;
Hu, Weihao ;
Cao, Di ;
Zhang, Man ;
Huang, Qi ;
Chen, Zhe ;
Blaabjerg, Frede .
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2021, 36 (03) :2173-2184
[8]   Smart distribution system management considering electrical and thermal demand response of energy hubs [J].
Davatgaran, Vahid ;
Saniei, Mohsen ;
Mortazavi, Seyed Saeidollah .
ENERGY, 2019, 169 :38-49
[9]   Intelligent hurricane resilience enhancement of power distribution systems via deep reinforcement learning [J].
Dehghani, Nariman L. ;
Jeddi, Ashkan B. ;
Shafieezadeh, Abdollah .
APPLIED ENERGY, 2021, 285
[10]   Intelligent wind farm control via deep reinforcement learning and high-fidelity simulations [J].
Dong, Hongyang ;
Zhang, Jincheng ;
Zhao, Xiaowei .
APPLIED ENERGY, 2021, 292