Reinforcement Learning Solutions for Microgrid Control and Management: A Survey

被引:0
作者
Barbalho, Pedro I. N. [1 ]
Moraes, Anderson L. [1 ]
Lacerda, Vinicius A. [2 ]
Barra, Pedro H. A. [3 ]
Fernandes, Ricardo A. S. [1 ]
Coury, Denis V. [1 ]
机构
[1] Univ Sao Paulo, Sao Carlos Sch Engn, Dept Elect & Comp Engn, BR-13566590 Sao Carlos, Brazil
[2] Univ Politecn Catalunya CITCEA UPC, Ctr Innovacio Tecnol Convertidors Estat & Accionam, Barcelona 08028, Spain
[3] Univ Fed Uberlandia, Fac Elect Engn, BR-38408100 Uberlandia, Brazil
基金
巴西圣保罗研究基金会;
关键词
Computational modeling; Prediction algorithms; Microgrids; Training; Surveys; Mathematical models; Heuristic algorithms; Artificial neural networks; Reinforcement learning; Power system stability; Distributed energy resources; hierarchical control; microgrid control; reinforcement learning; GRID-CONNECTED MICROGRIDS; ENERGY MANAGEMENT; HIERARCHICAL CONTROL; FREQUENCY CONTROL; DROOP CONTROL; INTELLIGENT CONTROL; POWER-CONTROL; DC; OPERATION; AC;
D O I
10.1109/ACCESS.2025.3546578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A microgrid (MG) is part of a distribution system that comprises loads and distributed energy resources, capable of operating either connected to or islanded from the primary grid. Having an appropriate design, MG controllers improve energy efficiency, playing a vital role in the modern distribution system. Thus, MG management and control has become a broad area of research due to its complex operation. Reinforcement learning (RL) offers adaptive solutions for handling MG complex dynamics and nonlinearity. It is an alternative to traditional algorithms and control methods in tasks, such as load frequency control, resource allocation, and energy management. Due to the relevance of the topic, this survey examined the role of RL in MG control and management, offering a comprehensive update on previous reviews, categorising articles by RL type, control objectives, and MG operational modes. Additionally, hardware implementations and performance assessments across RL-based solutions were evaluated. The present survey identified key research trends and gaps, contributing to understanding the role of RL in MG management and control and guiding future solutions in the field.
引用
收藏
页码:39782 / 39799
页数:18
相关论文
共 130 条
[51]   Data-Driven Dynamical Control for Bottom-up Energy Internet System [J].
Hua, Haochen ;
Qin, Zhaoming ;
Dong, Nanqing ;
Qin, Yuchao ;
Ye, Maojiao ;
Wang, Zidong ;
Chen, Xingying ;
Cao, Junwei .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2022, 13 (01) :315-327
[52]   Smooth and Uninterrupted Operation of Standalone DC Microgrid Under High and Low Penetration of RESs [J].
Hussan, Umair ;
Hassan, Mudasser ;
Ayub, Muhammad Ahsan ;
Peng, Jianchun ;
Rasheed, Hamna ;
Jiang, Hui ;
Asghar, Furqan .
IEEE ACCESS, 2024, 12 :48620-48629
[53]   Fuzzy logic-based voltage regulation of hybrid energy storage system in hybrid electric vehicles [J].
Hussan, Umair ;
Majeed, Muhammad Asghar ;
Asghar, Furqan ;
Waleed, Aashir ;
Khan, Asim ;
Javed, Muhammad Rameez .
ELECTRICAL ENGINEERING, 2022, 104 (02) :485-495
[54]  
Icarte Rodrigo Toro, 2022, Journal of Artificial Intelligence Research, V73, P173
[55]   Biologically inspired adaptive intelligent secondary control for MGs under cyber imperfections [J].
Jafari, Mohammad ;
Ghasemkhani, Amir ;
Sarfi, Vahid ;
Livani, Hanif ;
Yang, Lei ;
Xu, Hao .
IET CYBER-PHYSICAL SYSTEMS: THEORY & APPLICATIONS, 2019, 4 (04) :341-352
[56]   Load Frequency Control of an Isolated Micro Grid Using Fuzzy Adaptive Model Predictive Control [J].
Kayalvizhi, S. ;
Kumar, D. M. Vinod .
IEEE ACCESS, 2017, 5 :16241-16251
[57]   A Novel Deep Reinforcement Learning Controller Based Type-II Fuzzy System: Frequency Regulation in Microgrids [J].
Khooban, Mohammad Hassan ;
Gheisarnejad, Meysam .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2021, 5 (04) :689-699
[58]   Mobility-Aware Vehicle-to-Grid Control Algorithm in Microgrids [J].
Ko, Haneul ;
Pack, Sangheon ;
Leung, Victor C. M. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2018, 19 (07) :2165-2174
[59]   Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids [J].
Kofinas, P. ;
Dounis, A., I ;
Vouros, G. A. .
APPLIED ENERGY, 2018, 219 :53-67
[60]  
Kushwaha D. S., 2024, P IEEE POW EN SOC GE, P1