Optimal energy management strategies for energy Internet via deep reinforcement learning approach

被引:230
作者
Hua, Haochen [1 ]
Qin, Yuchao [1 ]
Hao, Chuantong [1 ]
Cao, Junwei [1 ]
机构
[1] Tsinghua Univ, Res Inst Informat Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy Internet; Energy routers; Optimal control; Deep reinforcement learning; RENEWABLE ENERGY; MICROGRIDS; ALGORITHM; SYSTEM; OPTIMIZATION;
D O I
10.1016/j.apenergy.2019.01.145
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper investigates the energy management problem in the field of energy Internet (EI) with interdisciplinary techniques. The concept of EI has been proposed for a while. However, there still exist many fundamental and technical issues that have not been fully investigated. In this paper, a new energy regulation issue is considered based on the operational principles of EI. Multiple targets are considered along with constraints. Then, the practical energy management problem is formulated as a constrained optimal control problem. Notably, no explicit mathematical model for power of renewable power generation devices and loads is utilized. Due to the complexity of this problem, conventional methods appear to be inapplicable. To obtain the desired control scheme, a model-free deep reinforcement learning algorithm is applied. A practical solution is obtained, and the feasibility as well as the performance of the proposed method are evaluated with numerical simulations.
引用
收藏
页码:598 / 609
页数:12
相关论文
共 50 条
[1]  
[Anonymous], IEEE T SMART GRID
[2]  
[Anonymous], AM CONTR C
[3]  
[Anonymous], 2016, Particle swarm optimization
[4]  
[Anonymous], IEEE INT C PROB METH
[5]  
[Anonymous], 2009, SMART GRID RENEWABLE
[6]  
[Anonymous], 2013, 3 IND REVOLUTIONHOW
[7]   Robust Frequency Control in an Islanded Microgrid: H∞ and μ-Synthesis Approaches [J].
Bevrani, Hassan ;
Feizi, Mohammad Ramin ;
Ataee, Sirwan .
IEEE TRANSACTIONS ON SMART GRID, 2016, 7 (02) :706-717
[8]   Renewable energy for a clean and sustainable future [J].
Bilgen, S ;
Kaygusuz, K ;
Sari, A .
ENERGY SOURCES, 2004, 26 (12) :1119-1129
[10]  
Cao J, 2018, The SAGE encyclopedia of the internet, P344