Deep Reinforcement Learning Control Strategy for Primary Frequency Regulation ofEnergy Storage Assisted Thermal Power Units

被引：0
|
作者：
Wang J. [1 ]
Sun R. [1 ]
Liu Z. [2 ]
Zhang X. [3 ]
Guo H. [1 ]
Hu H. [2 ]
机构：
[1] State Grid Henan Electric Power Company, Zhengzhou
[2] School of Automation Science and Engineering, Xi'an Jiaotong University, Xi'an
[3] Electric Power Research Institute of State Grid Henan Electric Power Company, Zhengzhou
来源：
Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University | 2024年 / 58卷 / 06期
关键词：
deep reinforcement learning; droop control; frequency dead band; primary frequency control; state of charge;
D O I：
10.7652/xjtuxb202406017
中图分类号：
学科分类号：
摘要：
In order to fully tap the potential of primary frequency modulation in the energy storage unit of the thermal-storage combined system and reduce the frequency regulation of thermal power units, a twin delayed deep deterministic policy gradient algorithm based energy storage assisted primary frequency regulation control strategy for thermal power unit is proposed. A typical regional power grid primary frequency regulation model containing thermal-storage combined frequency regulation system is established. Optimization problems with multiple objectives such as improving the frequency control effect of the power grid, maintaining a stable state of charge(SOC), and reducing the frequency regulation actions of thermal power unit are set. Taking into account the constraints of power grid operation status and frequency regulation actions, the primary frequency regulation problem of thermal power unit assisted by energy storage is modeled as a Markov decision process. Twin delayed deep deterministic policy gradient algorithm is used for optimization problem solving. The simulation results of typical frequency regulation task scenarios show that compared with traditional frequency regulation system control algorithms, the proposed energy storage assisted intelligent frequency regulation control strategy for thermal power units can reduce the average frequency difference of the power grid by about 10.4%, and reduce the frequency regulation actions of thermal power unit by about 56.2%. This verifies that the strategy can effectively release the frequency regulation potential of the thermal-storage combined system while significantly reducing frequency regulation of thermal power units. © 2024 Xi'an Jiaotong University. All rights reserved.
引用
收藏
页码：186 / 192
页数：6
相关论文
共 25 条
  • [1] ZHANG Jianyun, LI Mingjie, Analysis of the frequency characteristic of the power systems highly penetrated by new energy generation, Proceedings of the CSEE, 40, 11, pp. 3498-3506, (2020)
  • [2] YE Lin, WANG Kaifeng, LAI Yening, Et al., Review of frequency characteristics analysis and battery energy storage frequency regulation control strategies in power system under low inertia level, Power System Technology, 47, 2, pp. 446-462, (2023)
  • [3] LIU Ju, YAO Wei, WEN Jinyu, Et al., Impact of power grid strength and PLL parameters on stability of grid-connected DFIG wind farm, IEEE Transactions on Sustainable Energy, 11, 1, pp. 545-557, (2020)
  • [4] ZHANG Xiaoke, WANG ZI Jie, XIA Dawei, Et al., New modeling for primary frequency regulation capability of thermal power units under deep peak regulation, Power System Technology, 46, 12, pp. 4947-4953, (2022)
  • [5] ZHAO Dongyuan, HU Nan, FU Jing, Et al., Research on the practice and road map of enhancing the flexibility of a new generation power system in China, Power System Protection and Control, 48, 24, pp. 1-8, (2020)
  • [6] ZHUO Zhenyu, ZHANG Ning, XIE Xiaorong, Et al., Key technologies and developing challenges of power system with high proportion of renewable energy, Automation of Electric Power Systems, 45, 9, pp. 171-191, (2021)
  • [7] ZHANG Chengming, LIU Lu, CHENG Haozhong, Et al., Review and prospects of planning and operation optimization for electrical power systems considering frequency security, Power System Technology, 46, 1, pp. 250-264, (2022)
  • [8] LIU Chang, ZHUO Jiankun, ZHAO Dongming, Et al., A review on the utilization of energy storage system for the flexible and safe operation of renewable energy microgrids, Proceedings of the CSEE, 40, 1, pp. 1-18, (2020)
  • [9] LI Xinran, DENG Tao, HUANG Jiyuan, Et al., Battery energy storage systems self-adaptation control strategy in fast frequency regulation, High Voltage Engineering, 43, 7, pp. 2362-2369, (2017)
  • [10] DENG Xia, SUN Wei, XIAO Haiwei, Integrated control strategy of battery energy storage system in primary frequency regulation, High Voltage Engineering, 44, 4, pp. 1157-1165, (2018)
123