Multi-agent deep reinforcement learning with enhanced collaboration for distribution network voltage control

被引:8
作者
Huang, Jiapeng [1 ]
Zhang, Huifeng [1 ]
Tian, Ding [1 ]
Zhang, Zhen [1 ]
Yu, Chengqian [1 ]
Hancke, Gerhard P. [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Nanjing, Jiangsu, Peoples R China
关键词
Active voltage control; Multi -agent deep reinforcement learning; Distribution network; Photovoltaic; DISTRIBUTION-SYSTEMS; POWER; CAPACITORS; FRAMEWORK; INVERTER;
D O I
10.1016/j.engappai.2024.108677
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the increasing high penetration of Photovoltaic (PV), it brings great challenge for voltage control issue of distribution network. To address this problem, this paper presents an improved collaborative Multi -Agent Reinforcement Learning (MARL) approach for proactive voltage control, aimed at mitigating voltage violations and minimizing power losses. The self -attention mechanism is embedded into the multi -agent soft actorcritic (MASAC) algorithm to enhance the collaboration of multi -agent system, which can well improve the learning efficiency to ensure the voltage safety of Distribution Network. In addition, the proposed learning approach is implemented on IEEE 33 -bus, 141 -bus and 322 -bus systems, and the simulation results reveal that the proposed approach can control the voltage into safety domain as well as reduce power losses.
引用
收藏
页数:12
相关论文
共 51 条
[11]  
Gan LW, 2013, IEEE DECIS CONTR P, P2313, DOI 10.1109/CDC.2013.6760226
[12]  
Hashemi A., 2021, Handbook of AI-Based Metaheuristics, P119
[13]   Distributed Volt/VAr Control by PV Inverters [J].
Jahangiri, Pedram ;
Aliprantis, Dionysios C. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2013, 28 (03) :3429-3439
[14]   MGLNN: Semi-supervised learning via Multiple Graph Cooperative Learning Neural Networks [J].
Jiang, Bo ;
Chen, Si ;
Wang, Beibei ;
Luo, Bin .
NEURAL NETWORKS, 2022, 153 :204-214
[15]  
Jiang JC, 2018, ADV NEUR IN, V31
[16]   Maximum savings approach for location and sizing of capacitors in distribution systems [J].
Khodr, H. M. ;
Olsina, F. G. ;
De Oliveira-De Jesus, P. M. ;
Yusta, J. M. .
ELECTRIC POWER SYSTEMS RESEARCH, 2008, 78 (07) :1192-1203
[17]   Reinforcement learning in robotics: A survey [J].
Kober, Jens ;
Bagnell, J. Andrew ;
Peters, Jan .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1238-1274
[18]  
Lowe R, 2017, ADV NEUR IN, V30
[19]   SimBench-A Benchmark Dataset of Electric Power Systems to Compare Innovative Solutions Based on Power Flow Analysis [J].
Meinecke, Steffen ;
Sarajlic, Dzanan ;
Drauz, Simon Ruben ;
Klettke, Annika ;
Lauven, Lars-Peter ;
Rehtanz, Christian ;
Moser, Albert ;
Braun, Martin .
ENERGIES, 2020, 13 (12)
[20]   Gravitational search algorithm: a comprehensive analysis of recent variants [J].
Mittal, Himanshu ;
Tripathi, Ashish ;
Pandey, Avinash Chandra ;
Pal, Raju .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (05) :7581-7608