Adaptive Voltage and Frequency Regulation for Secondary Control via Reinforcement Learning for Islanded Microgrids

被引:6
作者
Sheida, Kouhyar [1 ]
Seyedi, Mohammad [1 ]
Ferdowsi, Farzad [1 ]
机构
[1] Univ Louisiana Lafayette, Dept Elect & Comp Engn, Lafayette, LA 70504 USA
来源
2024 IEEE TEXAS POWER AND ENERGY CONFERENCE, TPEC | 2024年
关键词
Secondary Control; Voltage Control; Frequency Control; Microgrids; PI Controller; Reinforcement Learning; HIERARCHICAL CONTROL; CONTROL STRATEGY; AC;
D O I
10.1109/TPEC60005.2024.10472240
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper demonstrates an innovative method to enhance the secondary control of microgrids in islanded conditions through the implementation of a Reinforcement Learning (RL) Controller based on Proportional-Integral (PI) principles. The aim is to adjust microgrid's voltage and frequency. The intelligent microgrid, incorporating diverse energy sources, represents the future of power grids. Ensuring its dependable operation requires sophisticated communication and clever data handling. Within this structure, Distributed Generations (DGs) utilize localized and worldwide control loops. for voltage and frequency regulation. A novel distributed secondary control scheme, employing a Reinforcement Learning (RL)-based Proportional-Integral (PI) controller, dynamically adjusts its parameters for optimal performance. The system consists of two Distributed Generators (DGs) linked to each other. The performance of the system is investigated under the islanded condition. The RL-based PI controller which uses the TD3 algorithm for training the agent outperforms the Conventional PI controller, demonstrating faster frequency and superior voltage regulation upon microgrids becoming islanded.
引用
收藏
页码:554 / 559
页数:6
相关论文
共 29 条
[1]   Hierarchical Control of Microgrid Using IoT and Machine Learning Based Islanding Detection [J].
Ali, Waleed ;
Ulasyar, Abasin ;
Mehmood, Mussawir Ul ;
Khattak, Abraiz ;
Imran, Kashif ;
Zad, Haris Sheh ;
Nisar, Shibli .
IEEE ACCESS, 2021, 9 :103019-103031
[2]   Deep reinforcement learning-based secondary control for microgrids in islanded mode [J].
Barbalho, P. I. N. ;
Lacerda, V. A. ;
Fernandes, R. A. S. ;
Coury, D., V .
ELECTRIC POWER SYSTEMS RESEARCH, 2022, 212
[3]   Intelligent Frequency Control in an AC Microgrid: Online PSO-Based Fuzzy Tuning Approach [J].
Bevrani, H. ;
Habibi, F. ;
Babahajyani, P. ;
Watanabe, M. ;
Mitani, Y. .
IEEE TRANSACTIONS ON SMART GRID, 2012, 3 (04) :1935-1944
[4]   Distributed Cooperative Secondary Control of Microgrids Using Feedback Linearization [J].
Bidram, Ali ;
Davoudi, Ali ;
Lewis, Frank L. ;
Guerrero, Josep M. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2013, 28 (03) :3462-3470
[5]   Hierarchical Structure of Microgrids Control System [J].
Bidram, Ali ;
Davoudi, Ali .
IEEE TRANSACTIONS ON SMART GRID, 2012, 3 (04) :1963-1976
[6]  
Chaturvedi Shivam, 2023, IEEE Transactions on Smart Grid
[7]   A Distributed Cooperative Secondary Control Scheme for Obtaining Power and Voltage References of Distributed Generations in Islanded DC Microgrids [J].
Dehaghani, M. Nabian ;
Biglarahmadia, M. ;
Mousavi, S. Y. Mousazadeh ;
Abdolahic, M. .
INTERNATIONAL JOURNAL OF ENGINEERING, 2024, 37 (02) :341-351
[8]   Decentralized Cooperative Control Strategy of Microsources for Stabilizing Autonomous VSC-Based Microgrids [J].
Divshali, Poria Hasanpor ;
Alimardani, Arash ;
Hosseinian, Seyed Hossein ;
Abedi, Mehrdad .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2012, 27 (04) :1949-1959
[9]   Efficient frequency controllers for autonomous two-area hybrid microgrid system using social-spider optimiser [J].
El-Fergany, Attia A. ;
El-Hameed, Mohammed A. .
IET GENERATION TRANSMISSION & DISTRIBUTION, 2017, 11 (03) :637-648
[10]   Secondary load frequency control for multi-microgrids: HiL real-time simulation [J].
Gheisarnejad, Meysam ;
Khooban, Mohammad Hassan .
SOFT COMPUTING, 2019, 23 (14) :5785-5798