Optimal dispatch of integrated energy system based on deep reinforcement learning

被引:14
作者
Zhou, Xiang [1 ]
Wang, Jiye [1 ]
Wang, Xinying [1 ]
Chen, Sheng [1 ]
机构
[1] China Elect Power Res Inst, Beijing 100192, Peoples R China
关键词
Integrated energy system; Optimal dispatch; Deep reinforcement learning; Uncertainty;
D O I
10.1016/j.egyr.2023.09.157
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Optimized scheduling of integrated energy systems is of great significance for achieving multi-energy complementarity and economic operation of the system. However, the intermittency of renewable energy sources and the uncertainty of user energy demand cause random fluctuations in the supply and demand sides of the system. Traditional scheduling methods are difficult to accurately adapt to the dynamic changes of the actual environment. In view of the uncertainty associated with renewable energy and load in integrated energy systems, an optimal dispatch method based on deep reinforcement learning is proposed. This study first outlines the methodology of deep reinforcement learning and then presents an optimal dispatch model based on this approach. The model incorporates a well-designed state space, action space, and reward function. Next, the process of model solving using the Asynchronous Advantage Actor-Critic (A3C) algorithm is described. Finally, simulation results demonstrate that the proposed method can adaptively respond to the uncertainty of energy sources and loads, and achieve optimal performance comparable to that of traditional mathematical programming methods.
引用
收藏
页码:373 / 378
页数:6
相关论文
共 25 条
[11]   On-Line Building Energy Optimization Using Deep Reinforcement Learning [J].
Mocanu, Elena ;
Mocanu, Decebal Constantin ;
Nguyen, Phuong H. ;
Liotta, Antonio ;
Webber, Michael E. ;
Gibescu, Madeleine ;
Slootweg, J. G. .
IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (04) :3698-3708
[12]   Renewable energy and climate change [J].
Olabi, A. G. ;
Abdelkareem, Mohammad Ali .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2022, 158
[13]  
Peng L., 2020, POWER SYSTEM AUTOMAT, V44, P33
[14]  
[苏永新 Su Yongxin], 2021, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V41, P5581
[15]   Day-ahead Optimization Schedule for Gas-electric Integrated Energy System Based on Second-order Cone Programming [J].
Sun, Yonghui ;
Zhang, Bowen ;
Ge, Leijiao ;
Sidorov, Denis ;
Wang, Jianxi ;
Xu, Zhou .
CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (01) :142-151
[16]   Deep Reinforcement Learning Method for Demand Response Management of Interruptible Load [J].
Wang, Biao ;
Li, Yan ;
Ming, Weiyu ;
Wang, Shaorong .
IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (04) :3146-3155
[17]  
[王海洋 Wang Haiyang], 2020, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V40, P5435
[18]   Deep Reinforcement Learning for Building HVAC Control [J].
Wei, Tianshu ;
Wang, Yanzhi ;
Zhu, Qi .
PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
[19]   Comparative study of optimization method and optimal operation strategy for multi-scenario integrated energy system [J].
Wu, Di ;
Han, Zhonghe ;
Liu, Zhijian ;
Li, Peng ;
Ma, Fanfan ;
Zhang, Han ;
Yin, Yunxing ;
Yang, Xinyan .
ENERGY, 2021, 217
[20]  
Xingyu Zhao, 2021, Power Syst. Technol., V45, P2319