Intelligent Frequency Control Strategy Based on Reinforcement Learning of Multi-Objective Collaborative Reward Function

被引:23
作者
Zhang, Lei [1 ]
Xie, Yumiao [1 ]
Ye, Jing [1 ]
Xue, Tianliang [1 ]
Cheng, Jiangzhou [1 ]
Li, Zhenhua [1 ]
Zhang, Tao [1 ]
机构
[1] China Three Gorges Univ, Coll Elect Engn & New Energy, Yichang, Peoples R China
基金
中国国家自然科学基金;
关键词
wind power grid-connected; intelligent frequency control strategy; multi-dimensional frequency control performance standard; Negotiated W-Learning algorithm; global optimization; POWER;
D O I
10.3389/fenrg.2021.760525
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Large scale wind power integration into the power grid will pose a serious threat to the frequency control of power system. If only Control Performance Standard (CPS) index is used as the evaluation standard of frequency quality, it will easily lead to short-term centralized frequency crossing, which will affect the effect of intelligent Automatic Generation Control (AGC) on frequency quality. In order to solve this problem, a multi-objective collaborative reward function is constructed by introducing a collaborative evaluation mechanism with multiple evaluation indexes. In addition, Negotiated W-Learning strategy is proposed to globally optimize the solution of the objective function from multi dimensions, it avoids the poor learning efficiency of the traditional Greedy strategy. The AGC control model simulation of standard two area interconnected power grid shows that the proposed intelligent strategy can effectively improve the frequency control performance and improve the frequency quality of the system in the whole-time scale.
引用
收藏
页数:8
相关论文
共 28 条
[1]   Load frequency regulation for multi-area power system using integral reinforcement learning [J].
Abouheaf, Mohammed ;
Gueaieb, Wail ;
Sharaf, Adel .
IET GENERATION TRANSMISSION & DISTRIBUTION, 2019, 13 (19) :4311-4323
[2]  
Ahamed TPI, 2002, ELECTR POW SYST RES, V63, P9, DOI 10.1016/S0378-7796(02)00088-3
[3]   Challenges and Opportunities of Load Frequency Control in Conventional, Modern and Future Smart Power Systems: A Comprehensive Review [J].
Alhelou, Hassan Haes ;
Hamedani-Golshan, Mohamad-Esmail ;
Zamani, Reza ;
Heydarian-Forushani, Ehsan ;
Siano, Pierluigi .
ENERGIES, 2018, 11 (10)
[4]   Optimal control strategy-based AGC of electrical power systems: A comparative performance analysis [J].
Arya, Yogendra ;
Kumar, Narendra .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2017, 38 (06) :982-992
[5]  
Kumar A, 2019, 2019 3RD INTERNATIONAL CONFERENCE ON RECENT DEVELOPMENTS IN CONTROL, AUTOMATION & POWER ENGINEERING (RDCAPE), P153, DOI [10.1109/RDCAPE47089.2019.8979071, 10.1109/rdcape47089.2019.8979071]
[6]   Research on a Composite Voltage and Current Measurement Device for HVDC Networks [J].
Li, Zhenhua ;
Jiang, Weihui ;
Abu-Siada, Ahmed ;
Li, Zhenxing ;
Xu, Yanchun ;
Liu, Songkai .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (09) :8930-8941
[7]   Real-time vehicle-to-grid control for frequency regulation with high frequency regulating signal [J].
Liu H. ;
Huang K. ;
Yang Y. ;
Wei H. ;
Ma S. .
Protection and Control of Modern Power Systems, 2018, 3 (01)
[8]   Multi-Lateral Participants Decision-Making: A Distribution System Planning Approach With Incomplete Information Game [J].
Liu, Yi ;
Yang, Nan ;
Dong, Bangtian ;
Wu, Lei ;
Yan, Jing ;
Shen, Xun ;
Xing, Chao ;
Liu, Songkai ;
Huang, Yuehua .
IEEE ACCESS, 2020, 8 :88933-88950
[9]  
Nathan S., 2003, THESIS U ROCHESTER R
[10]   Sample-Based Neural Approximation Approach for Probabilistic Constrained Programs [J].
Shen, Xun ;
Ouyang, Tinghui ;
Yang, Nan ;
Zhuang, Jiancang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (02) :1058-1065