Reinforcement Learning Solutions for Microgrid Control and Management: A Survey

被引:0
作者
Barbalho, Pedro I. N. [1 ]
Moraes, Anderson L. [1 ]
Lacerda, Vinicius A. [2 ]
Barra, Pedro H. A. [3 ]
Fernandes, Ricardo A. S. [1 ]
Coury, Denis V. [1 ]
机构
[1] Univ Sao Paulo, Sao Carlos Sch Engn, Dept Elect & Comp Engn, BR-13566590 Sao Carlos, Brazil
[2] Univ Politecn Catalunya CITCEA UPC, Ctr Innovacio Tecnol Convertidors Estat & Accionam, Barcelona 08028, Spain
[3] Univ Fed Uberlandia, Fac Elect Engn, BR-38408100 Uberlandia, Brazil
基金
巴西圣保罗研究基金会;
关键词
Computational modeling; Prediction algorithms; Microgrids; Training; Surveys; Mathematical models; Heuristic algorithms; Artificial neural networks; Reinforcement learning; Power system stability; Distributed energy resources; hierarchical control; microgrid control; reinforcement learning; GRID-CONNECTED MICROGRIDS; ENERGY MANAGEMENT; HIERARCHICAL CONTROL; FREQUENCY CONTROL; DROOP CONTROL; INTELLIGENT CONTROL; POWER-CONTROL; DC; OPERATION; AC;
D O I
10.1109/ACCESS.2025.3546578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A microgrid (MG) is part of a distribution system that comprises loads and distributed energy resources, capable of operating either connected to or islanded from the primary grid. Having an appropriate design, MG controllers improve energy efficiency, playing a vital role in the modern distribution system. Thus, MG management and control has become a broad area of research due to its complex operation. Reinforcement learning (RL) offers adaptive solutions for handling MG complex dynamics and nonlinearity. It is an alternative to traditional algorithms and control methods in tasks, such as load frequency control, resource allocation, and energy management. Due to the relevance of the topic, this survey examined the role of RL in MG control and management, offering a comprehensive update on previous reviews, categorising articles by RL type, control objectives, and MG operational modes. Additionally, hardware implementations and performance assessments across RL-based solutions were evaluated. The present survey identified key research trends and gaps, contributing to understanding the role of RL in MG management and control and guiding future solutions in the field.
引用
收藏
页码:39782 / 39799
页数:18
相关论文
共 130 条
[71]  
Mataric M. J., 1994, Reward Functions for Accelerated Learning, P181
[72]   Distributed optimization for scheduling energy flows in community microgrids [J].
Mbuwir, Brida, V ;
Spiessens, Fred ;
Deconinck, Geert .
ELECTRIC POWER SYSTEMS RESEARCH, 2020, 187
[73]   Reinforcement learning for control of flexibility providers in a residential microgrid [J].
Mbuwir, Brida V. ;
Geysen, Davy ;
Spiessens, Fred ;
Deconinck, Geert .
IET SMART GRID, 2020, 3 (01) :98-107
[74]   Battery Energy Management in a Microgrid Using Batch Reinforcement Learning [J].
Mbuwir, Brida V. ;
Ruelens, Frederik ;
Spiessens, Fred ;
Deconinck, Geert .
ENERGIES, 2017, 10 (11)
[75]   Microgrid supervisory controllers and energy management systems: A literature review [J].
Meng, Lexuan ;
Sanseverino, Eleonora Riva ;
Luna, Adriana ;
Dragicevic, Tomislav ;
Vasquez, Juan C. ;
Guerrero, Josep M. .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2016, 60 :1263-1273
[76]   Design of controller and communication for frequency regulation of a smart microgrid [J].
Mishra, S. ;
Mallesham, G. ;
Jha, A. N. .
IET RENEWABLE POWER GENERATION, 2012, 6 (04) :248-258
[77]   Data-driven based optimal distributed frequency control for islanded AC microgrids [J].
Mo, Ni-Lei ;
Guan, Zhi-Hong ;
Zhang, Ding-Xue ;
Cheng, Xin-Ming ;
Liu, Zhi-Wei ;
Li, Tao .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2020, 119
[78]   Multi-operation management of a typical micro-grids using Particle Swarm Optimization: A comparative study [J].
Moghaddam, Amjad Anvari ;
Seifi, Alireza ;
Niknam, Taher .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2012, 16 (02) :1268-1281
[79]   State-Space Modeling, Analysis, and Distributed Secondary Frequency Control of Isolated Microgrids [J].
Mohammadi, Farideh Doost ;
Vanashi, Hessam Keshtkar ;
Feliachi, Ali .
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2018, 33 (01) :155-165
[80]   Multi-Objective Interval Optimization Dispatch of Microgrid via Deep Reinforcement Learning [J].
Mu, Chaoxu ;
Shi, Yakun ;
Xu, Na ;
Wang, Xinying ;
Tang, Zhuo ;
Jia, Hongjie ;
Geng, Hua .
IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (03) :2957-2970