Optimal dispatch of integrated energy system based on deep reinforcement learning

被引:14
作者
Zhou, Xiang [1 ]
Wang, Jiye [1 ]
Wang, Xinying [1 ]
Chen, Sheng [1 ]
机构
[1] China Elect Power Res Inst, Beijing 100192, Peoples R China
关键词
Integrated energy system; Optimal dispatch; Deep reinforcement learning; Uncertainty;
D O I
10.1016/j.egyr.2023.09.157
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Optimized scheduling of integrated energy systems is of great significance for achieving multi-energy complementarity and economic operation of the system. However, the intermittency of renewable energy sources and the uncertainty of user energy demand cause random fluctuations in the supply and demand sides of the system. Traditional scheduling methods are difficult to accurately adapt to the dynamic changes of the actual environment. In view of the uncertainty associated with renewable energy and load in integrated energy systems, an optimal dispatch method based on deep reinforcement learning is proposed. This study first outlines the methodology of deep reinforcement learning and then presents an optimal dispatch model based on this approach. The model incorporates a well-designed state space, action space, and reward function. Next, the process of model solving using the Asynchronous Advantage Actor-Critic (A3C) algorithm is described. Finally, simulation results demonstrate that the proposed method can adaptively respond to the uncertainty of energy sources and loads, and achieve optimal performance comparable to that of traditional mathematical programming methods.
引用
收藏
页码:373 / 378
页数:6
相关论文
共 25 条
[1]   Optimal coordination of hydrogen-based integrated energy systems with combination of hydrogen and water storage [J].
Dong, Xiangxiang ;
Wu, Jiang ;
Xu, Zhanbo ;
Liu, Kun ;
Guan, Xiaohong .
APPLIED ENERGY, 2022, 308
[2]  
Dunnan Liu, 2021, Autom. of Elec. Power Syst., P09
[3]  
Hong Liang, 2021, Power Syst. Technol., P1
[4]  
Hong Zhang, 2020, Proc. CSEE, V40, P379
[5]  
Hongsheng Xu, 2021, Autom. of Electric Power Syst, V45, P97
[6]   Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning [J].
Li, Hepeng ;
Wan, Zhiqiang ;
He, Haibo .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (03) :2427-2439
[7]  
[李晓露 Li Xiaolu], 2019, [电力系统自动化, Automation of Electric Power Systems], V43, P52
[8]  
[李政洁 Li Zhengjie], 2021, [电力系统保护与控制, Power System Protection and Control], V49, P36
[9]  
[刘兴宇 Liu Xingyu], 2017, [电工技术学报, Transactions of China Electrotechnical Society], V32, P169
[10]  
Liu Y., 2020, CSEE J. Power Energy Syst.