Multi-agent deep reinforcement learning with enhanced collaboration for distribution network voltage control

被引:8
作者
Huang, Jiapeng [1 ]
Zhang, Huifeng [1 ]
Tian, Ding [1 ]
Zhang, Zhen [1 ]
Yu, Chengqian [1 ]
Hancke, Gerhard P. [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Nanjing, Jiangsu, Peoples R China
关键词
Active voltage control; Multi -agent deep reinforcement learning; Distribution network; Photovoltaic; DISTRIBUTION-SYSTEMS; POWER; CAPACITORS; FRAMEWORK; INVERTER;
D O I
10.1016/j.engappai.2024.108677
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the increasing high penetration of Photovoltaic (PV), it brings great challenge for voltage control issue of distribution network. To address this problem, this paper presents an improved collaborative Multi -Agent Reinforcement Learning (MARL) approach for proactive voltage control, aimed at mitigating voltage violations and minimizing power losses. The self -attention mechanism is embedded into the multi -agent soft actorcritic (MASAC) algorithm to enhance the collaboration of multi -agent system, which can well improve the learning efficiency to ensure the voltage safety of Distribution Network. In addition, the proposed learning approach is implemented on IEEE 33 -bus, 141 -bus and 322 -bus systems, and the simulation results reveal that the proposed approach can control the voltage into safety domain as well as reduce power losses.
引用
收藏
页数:12
相关论文
共 51 条
[1]   Distribution Voltage Control Considering the Impact of PV Generation on Tap Changers and Autonomous Regulators [J].
Agalgaonkar, Yashodhan P. ;
Pal, Bikash C. ;
Jabr, Rabih A. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2014, 29 (01) :182-192
[2]   Voltage and Reactive Power Control to Maximize the Energy Savings in Power Distribution System With Wind Energy [J].
Anilkumar, Rahul ;
Devriese, Griet ;
Srivastava, Anurag K. .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2018, 54 (01) :656-664
[3]  
[Anonymous], 2018, 15472018 IEEE, DOI [DOI 10.1109/IEEESTD.2018.8291741, DOI 10.1109/IEEESTD.2018.8332112]
[4]  
[Anonymous], 2020, About us
[5]   Network-Cognizant Voltage Droop Control for Distribution Grids [J].
Baker, Kyri ;
Bernstein, Andrey ;
Dall'Anese, Emiliano ;
Zhao, Changhong .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (02) :2098-2108
[6]   NETWORK RECONFIGURATION IN DISTRIBUTION-SYSTEMS FOR LOSS REDUCTION AND LOAD BALANCING [J].
BARAN, ME ;
WU, FF .
IEEE TRANSACTIONS ON POWER DELIVERY, 1989, 4 (02) :1401-1407
[7]   Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs [J].
Cao, Di ;
Zhao, Junbo ;
Hu, Weihao ;
Ding, Fei ;
Huang, Qi ;
Chen, Zhe .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2021, 12 (03) :1582-1592
[8]   A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Huang, Qi ;
Chen, Zhe ;
Blaabjerg, Frede .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (05) :4120-4123
[9]   Decentralized safe reinforcement learning for inverter-based voltage control [J].
Cui, Wenqi ;
Li, Jiayi ;
Zhang, Baosen .
ELECTRIC POWER SYSTEMS RESEARCH, 2022, 211
[10]   On Distributed PV Hosting Capacity Estimation, Sensitivity Study, and Improvement [J].
Ding, Fei ;
Mather, Barry .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2017, 8 (03) :1010-1020