Optimal energy management strategies for energy Internet via deep reinforcement learning approach

被引:230
作者
Hua, Haochen [1 ]
Qin, Yuchao [1 ]
Hao, Chuantong [1 ]
Cao, Junwei [1 ]
机构
[1] Tsinghua Univ, Res Inst Informat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy Internet; Energy routers; Optimal control; Deep reinforcement learning; RENEWABLE ENERGY; MICROGRIDS; ALGORITHM; SYSTEM; OPTIMIZATION;
D O I
10.1016/j.apenergy.2019.01.145
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper investigates the energy management problem in the field of energy Internet (EI) with interdisciplinary techniques. The concept of EI has been proposed for a while. However, there still exist many fundamental and technical issues that have not been fully investigated. In this paper, a new energy regulation issue is considered based on the operational principles of EI. Multiple targets are considered along with constraints. Then, the practical energy management problem is formulated as a constrained optimal control problem. Notably, no explicit mathematical model for power of renewable power generation devices and loads is utilized. Due to the complexity of this problem, conventional methods appear to be inapplicable. To obtain the desired control scheme, a model-free deep reinforcement learning algorithm is applied. A practical solution is obtained, and the feasibility as well as the performance of the proposed method are evaluated with numerical simulations.
引用
收藏
页码:598 / 609
页数:12
相关论文
共 50 条
[31]  
Mao X., 2007, STOCHASTIC DIFFERENT
[32]  
Marino DL, 2016, IEEE IND ELEC, P7046, DOI 10.1109/IECON.2016.7793413
[33]   Smart Energy Systems for coherent 100% renewable energy and transport solutions [J].
Mathiesen, B.V. ;
Lund, H. ;
Connolly, D. ;
Wenzel, H. ;
Ostergaard, P.A. ;
Moller, B. ;
Nielsen, S. ;
Ridjan, I. ;
Karnoe, P. ;
Sperling, K. ;
Hvelplund, F.K. .
APPLIED ENERGY, 2015, 145 :139-154
[34]  
Mnih V., 2016, PROC INT C MACH LEAR
[35]   Structure-Preserved Power System Transient Stability Using Stochastic Energy Functions [J].
Odun-Ayo, Theresa ;
Crow, Mariesa L. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2012, 27 (03) :1450-1458
[36]  
Sak H, 2014, INTERSPEECH, P338
[37]   A Multiagent-Based Consensus Algorithm for Distributed Coordinated Control of Distributed Generators in the Energy Internet [J].
Sun, Qiuye ;
Han, Renke ;
Zhang, Huaguang ;
Zhou, Jianguo ;
Guerrero, Josep M. .
IEEE TRANSACTIONS ON SMART GRID, 2015, 6 (06) :3006-3019
[38]   Second order numerical methods for first order Hamilton-Jacobi equations [J].
Szpiro, A ;
Dupuis, P .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 2002, 40 (03) :1136-1183
[39]   Pandapower-An Open-Source Python']Python Tool for Convenient Modeling, Analysis, and Optimization of Electric Power Systems [J].
Thurner, Leon ;
Scheidler, Alexander ;
Schafer, Florian ;
Menke, Jan-Hendrik ;
Dollichon, Julian ;
Meier, Friederike ;
Meinecke, Steffen ;
Braun, Martin .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (06) :6510-6521
[40]  
Turchetta M, 2016, ADV NEUR IN, V29