Adaptive Voltage and Frequency Regulation for Secondary Control via Reinforcement Learning for Islanded Microgrids

被引:6
作者
Sheida, Kouhyar [1 ]
Seyedi, Mohammad [1 ]
Ferdowsi, Farzad [1 ]
机构
[1] Univ Louisiana Lafayette, Dept Elect & Comp Engn, Lafayette, LA 70504 USA
来源
2024 IEEE TEXAS POWER AND ENERGY CONFERENCE, TPEC | 2024年
关键词
Secondary Control; Voltage Control; Frequency Control; Microgrids; PI Controller; Reinforcement Learning; HIERARCHICAL CONTROL; CONTROL STRATEGY; AC;
D O I
10.1109/TPEC60005.2024.10472240
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper demonstrates an innovative method to enhance the secondary control of microgrids in islanded conditions through the implementation of a Reinforcement Learning (RL) Controller based on Proportional-Integral (PI) principles. The aim is to adjust microgrid's voltage and frequency. The intelligent microgrid, incorporating diverse energy sources, represents the future of power grids. Ensuring its dependable operation requires sophisticated communication and clever data handling. Within this structure, Distributed Generations (DGs) utilize localized and worldwide control loops. for voltage and frequency regulation. A novel distributed secondary control scheme, employing a Reinforcement Learning (RL)-based Proportional-Integral (PI) controller, dynamically adjusts its parameters for optimal performance. The system consists of two Distributed Generators (DGs) linked to each other. The performance of the system is investigated under the islanded condition. The RL-based PI controller which uses the TD3 algorithm for training the agent outperforms the Conventional PI controller, demonstrating faster frequency and superior voltage regulation upon microgrids becoming islanded.
引用
收藏
页码:554 / 559
页数:6
相关论文
共 29 条
[21]  
Paridari K, 2013, 2013 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), P1812, DOI 10.1109/ICIT.2013.6505951
[22]  
Sutton RS, 2018, ADAPT COMPUT MACH LE, P1
[23]  
TImothy P.Lillicrap., 2016, CONTINUOUS CONTROL D
[24]   Controlling distributed energy resources via deep reinforcement learning for load flexibility and energy efficiency [J].
Touzani, Samir ;
Prakash, Anand Krishnan ;
Wang, Zhe ;
Agarwal, Shreya ;
Pritoni, Marco ;
Kiran, Mariam ;
Brown, Richard ;
Granderson, Jessica .
APPLIED ENERGY, 2021, 304 (304)
[25]   A-TD3: An Adaptive Asynchronous Twin Delayed Deep Deterministic for Continuous Action Spaces [J].
Wu, Jiaolv ;
Wu, Q. M. Jonathan ;
Chen, Shuyue ;
Pourpanah, Farhad ;
Huang, Detian .
IEEE ACCESS, 2022, 10 :128077-128089
[26]   Data-Driven Load Frequency Control for Stochastic Power Systems: A Deep Reinforcement Learning Method With Continuous Action Search [J].
Yan, Ziming ;
Xu, Yan .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2019, 34 (02) :1653-1656
[27]   A Novel Event-Triggered Secondary Control Strategy for Distributed Generalized Droop Control in Microgrid Considering Time Delay [J].
Zhang, Jiancheng ;
Sun, Bo ;
Zhao, Daduan .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2023, 38 (05) :5963-5978
[28]  
Zhao C., 2023, IEEE Systems Journal
[29]   Distributed Power Sharing Control Based on Adaptive Virtual Impedance in Seaport Microgrids With Cold Ironing [J].
Zhao, Peng ;
Ma, Kai ;
Yang, Jie ;
Yang, Bo ;
Guerrero, Josep M. ;
Dou, Chunxia ;
Guan, Xinping .
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2023, 9 (02) :2472-2485