Optimal operation strategy of microgrid based on deep reinforcement learning

被引:0
|
作者
Zhao P. [1 ]
Wu J. [1 ]
Wang Y. [1 ]
Zhang H. [1 ]
机构
[1] School of Electrical Engineering, Beijing Jiaotong University, Beijing
关键词
deep reinforcement learning; Markov model; microgrid; optimal operation;
D O I
10.16081/j.epae.202205032
中图分类号
学科分类号
摘要
The uncertainty of wind power,photovoltaic and load brings challenges to the formulation of opera⁃ tion strategy for microgrid with high proportion of renewable energy,and the development of artificial intelli⁃ gence technology provides a new idea for solving the operation optimization problem of microgrid. Based on the reinforcement learning framework,the operation problem of microgrid is transformed into a Markov decision process,and an online scheduling method of microgrid based on deep reinforcement learning is proposed,which takes the maximum economic benefit of microgrid and residents’satisfaction as its object. In order to effectively use the experience in the training process of deep reinforcement learning,a PES-DDPG(Priority Experience Storage Deep Deterministic Policy Gradient) algorithm is designed to learn the optimal scheduling strategy of microgrid for different periods under each type of environment. Case results show that PES-DDPG algorithm can provide effective scheduling strategy for microgrid and realize real-time optimization of microgrid. © 2022 Electric Power Automation Equipment Press. All rights reserved.
引用
收藏
页码:9 / 16
页数:7
相关论文
共 19 条
  • [1] YANG Xinfa, SU Jian, LU Zhipeng, Et al., Overview on microgrid technology[J], Proceedings of the CSEE, 34, 1, pp. 57-70, (2014)
  • [2] ORDONEZ M, MOHAMED Y A R I., Energy management in multi-microgrid systems-development and assessment [J], IEEE Transactions on Power Systems, 32, 2, pp. 910-922, (2017)
  • [3] WU Xiong, WANG Xiuli, LIU Shimin, Et al., Summary of re⁃ search on microgrid energy management system[J], Electric Power Automation Equipment, 34, 10, pp. 7-14, (2014)
  • [4] BENBOUZID M., Microgrids energy management systems:a critical review on methods,solutions,and prospects[J], Applied Energy, 222, pp. 1033-1055, (2018)
  • [5] LI Chiyu, GAO Hongjun, LIU Youbo, Et al., Optimal sharing operation strategy for multi park-level microgrid[J], Electric Power Automation Equipment, 40, 3, pp. 29-36, (2020)
  • [6] LU Zhuoxin, XU Xiaoyuan, YAN Zheng, Et al., Overview on data-driven optimal scheduling methods of power system in uncertain environment[J], Automation of Electric Power Sys⁃ tems, 44, 21, pp. 172-183, (2020)
  • [7] CHENG Shan, NI Kaixuan, ZHAO Mengyu, Stackelberg game based bi-level coordinated optimal scheduling of microgrid accessed with charging-swapping-storage integrated station[J], Electric Power Automation Equipment, 40, 6, pp. 49-55, (2020)
  • [8] YOU F Q., Data-driven stochastic robust optimization:general computational framework and algorithm leveraging machine learning for optimization under uncertainty in the big data era[J], Computers & Chemical Engineering, 111, pp. 115-133, (2018)
  • [9] YOU F Q., Distributionally robust optimization for planning and scheduling under uncertainty[J], Computers & Chemical Engineering, 110, pp. 53-68, (2018)
  • [10] YANG Ting, ZHAO Liyuan, WANG Chengshan, Review on ap⁃ plication of artificial intelligence in power system and inte⁃ grated energy system[J], Automation of Electric Power Sys⁃ tems, 43, 1, pp. 2-14, (2019)