Reinforcement Learning Solutions for Microgrid Control and Management: A Survey

被引:0
作者
Barbalho, Pedro I. N. [1 ]
Moraes, Anderson L. [1 ]
Lacerda, Vinicius A. [2 ]
Barra, Pedro H. A. [3 ]
Fernandes, Ricardo A. S. [1 ]
Coury, Denis V. [1 ]
机构
[1] Univ Sao Paulo, Sao Carlos Sch Engn, Dept Elect & Comp Engn, BR-13566590 Sao Carlos, Brazil
[2] Univ Politecn Catalunya CITCEA UPC, Ctr Innovacio Tecnol Convertidors Estat & Accionam, Barcelona 08028, Spain
[3] Univ Fed Uberlandia, Fac Elect Engn, BR-38408100 Uberlandia, Brazil
基金
巴西圣保罗研究基金会;
关键词
Computational modeling; Prediction algorithms; Microgrids; Training; Surveys; Mathematical models; Heuristic algorithms; Artificial neural networks; Reinforcement learning; Power system stability; Distributed energy resources; hierarchical control; microgrid control; reinforcement learning; GRID-CONNECTED MICROGRIDS; ENERGY MANAGEMENT; HIERARCHICAL CONTROL; FREQUENCY CONTROL; DROOP CONTROL; INTELLIGENT CONTROL; POWER-CONTROL; DC; OPERATION; AC;
D O I
10.1109/ACCESS.2025.3546578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A microgrid (MG) is part of a distribution system that comprises loads and distributed energy resources, capable of operating either connected to or islanded from the primary grid. Having an appropriate design, MG controllers improve energy efficiency, playing a vital role in the modern distribution system. Thus, MG management and control has become a broad area of research due to its complex operation. Reinforcement learning (RL) offers adaptive solutions for handling MG complex dynamics and nonlinearity. It is an alternative to traditional algorithms and control methods in tasks, such as load frequency control, resource allocation, and energy management. Due to the relevance of the topic, this survey examined the role of RL in MG control and management, offering a comprehensive update on previous reviews, categorising articles by RL type, control objectives, and MG operational modes. Additionally, hardware implementations and performance assessments across RL-based solutions were evaluated. The present survey identified key research trends and gaps, contributing to understanding the role of RL in MG management and control and guiding future solutions in the field.
引用
收藏
页码:39782 / 39799
页数:18
相关论文
共 130 条
[1]   Vulnerability Identification and Remediation of FDI Attacks in Islanded DC Microgrids Using Multiagent Reinforcement Learning [J].
Abianeh, Ali Jafarian ;
Wan, Yihao ;
Ferdowsi, Farzad ;
Mijatovic, Nenad ;
Dragicevic, Tomislav .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2022, 37 (06) :6359-6370
[2]   A fuzzy logic-based droop control for simultaneous voltage and frequency regulation in an AC microgrid [J].
Ahmadi, Saleh ;
Shokoohi, Shoresh ;
Bevrani, Hassan .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2015, 64 :148-155
[3]   A review on microgrid optimization with meta-heuristic techniques: Scopes, trends and recommendation [J].
Akter, Afifa ;
Zafir, Ehsanul Islam ;
Dana, Nazia Hasan ;
Oysoyal, Rahul J. ;
Sarker, Subrata K. ;
Li, Li ;
Muyeen, S. M. ;
Das, Sajal K. ;
Kamwa, Innocent .
ENERGY STRATEGY REVIEWS, 2024, 51
[4]   Power quality enhancement in autonomous microgrid operation using Particle Swarm Optimization [J].
Al-Saedi, Waleed ;
Lachowicz, Stefan W. ;
Habibi, Daryoush ;
Bass, Octavian .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2012, 42 (01) :139-149
[5]   Adaptive Voltage and Frequency Control of Islanded Multi-Microgrids [J].
Amoateng, David Ofosu ;
Al Hosani, Mohamed ;
Elmoursi, Mohamed Shawky ;
Turitsyn, Konstantin ;
Kirtley, James L., Jr. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (04) :4454-4465
[6]   A survey of inverse reinforcement learning: Challenges, methods and progress [J].
Arora, Saurabh ;
Doshi, Prashant .
ARTIFICIAL INTELLIGENCE, 2021, 297 (297)
[7]   Deep Reinforcement Learning A brief survey [J].
Arulkumaran, Kai ;
Deisenroth, Marc Peter ;
Brundage, Miles ;
Bharath, Anil Anthony .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) :26-38
[8]   Reinforcement Learning Techniques for Optimal Power Control in Grid-Connected Microgrids: A Comprehensive Review [J].
Arwa, Erick O. ;
Folly, Komla A. .
IEEE ACCESS, 2020, 8 :208992-209007
[9]   Optimal energy management of MG for cost-effective operations and battery scheduling using BWO [J].
Ayub, Muhammad Ahsan ;
Hussan, Umair ;
Rasheed, Hamna ;
Liu, Yitao ;
Peng, Jianchun .
ENERGY REPORTS, 2024, 12 :294-304
[10]   Enhancing Power Quality in Microgrids With a New Online Control Strategy for DSTATCOM Using Reinforcement Learning Algorithm [J].
Bagheri, Mehdi ;
Nurmanova, Venera ;
Abedinia, Oveis ;
Naderi, Mohammad Salay .
IEEE ACCESS, 2018, 6 :38986-38996