Optimal scheduling of virtual power plant based on Soft Actor-Critic algorithm

被引:1
作者
Pan, Pengfei [1 ]
Song, Minggang [1 ]
Zou, Nan [1 ]
Qin, Junhan [1 ]
Li, Guangdi [2 ]
Ma, Hongyuan [2 ]
机构
[1] Dalian Power Supply Co Ltd, State Grid Liaoning Elect Power Supply Co Ltd, Dalian, Peoples R China
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Peoples R China
来源
2024 6TH ASIA ENERGY AND ELECTRICAL ENGINEERING SYMPOSIUM, AEEES 2024 | 2024年
关键词
Virtual power plant; deep reinforcement learning; optimal scheduling; Soft Actor-Critic algorithm;
D O I
10.1109/AEEES61147.2024.10544891
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Aiming at the problem that distributed power sources are difficult to be centrally scheduled and optimized, a virtual power plant (VPP) optimization scheduling method based on deep reinforcement learning is proposed. The method can adaptively adapt to the uncertainty of source load and give real-time optimal scheduling strategies in the presence of source load fluctuations. First, the system framework of VPP is constructed, and the optimal scheduling model of VPP is established with the objective function of minimum daily operating cost, and various operating condition constraints are practically considered. Then, the basic principle and process of deep reinforcement learning are introduced, and the constructed VPP optimal scheduling model is transformed into a deep reinforcement learning model, and the state space, action space and reward function are reasonably designed. Following that, Soft Actor-Critic algorithm (SAC) is used for offline training, and the trained model is utilized for online decision making. Finally, the simulation is carried out in an area as an example, and the results show that the VPP optimal scheduling strategy proposed in this paper can effectively reduce the operating cost of VPP and ensure the safe operation of the grid after grid connection.
引用
收藏
页码:835 / 840
页数:6
相关论文
共 12 条
[1]  
Fang D, 2021, IEEE Internet of Things Journal
[2]  
Guili Yuan, Combined heat and power scheduling optimization for virtual power plants considering carbon capture and demand response, P1
[3]   Deep Reinforcement Learning for Economic Dispatch of Virtual Power Plant in Internet of Energy [J].
Lin, Lin ;
Guan, Xin ;
Peng, Yu ;
Wang, Ning ;
Maharjan, Sabita ;
Ohtsuki, Tomoaki .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6288-6301
[4]  
Liu X., 2022, IEEE Transactions on Smart Grid
[5]   Day-ahead scheduling of virtual power plant in joint energy and regulation reserve markets under uncertainties [J].
Shayegan-Rad, Ali ;
Badri, Ali ;
Zangeneh, Ali .
ENERGY, 2017, 121 :114-125
[6]  
Wei Jiang, 2023, Electric Power Engineering Technology
[7]  
Xiao J, 2023, P 2023 8 AS C POW EL
[8]  
Zhang Jinyuan, 2020, Multi-agent Deep Reinforcement Learning Based Optimal Dispatch of Distributed Generators
[9]  
Zhao F J, 2022, P 2022 GLOB REL PROG
[10]  
Zhou Renjun, 2018, P CSEE