A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration

被引:3
|
作者
Si, Ruiqi [1 ]
Chen, Siyuan [1 ]
Zhang, Jun [1 ]
Xu, Jian [1 ]
Zhang, Luxi [2 ]
机构
[1] Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China
[2] Brandeis Univ, Waltham, MA 02454 USA
基金
国家重点研发计划;
关键词
Deep reinforcement learning; Multi-agent reinforcement learning; Distribution system restoration; Distribution network; Microgrid; UNBALANCED DISTRIBUTION-SYSTEMS; SERVICE RESTORATION; MANAGEMENT; MODEL;
D O I
10.1016/j.apenergy.2024.123625
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Extreme weather, chain failures, and other events have increased the probability of wide-area blackouts, which highlights the importance of rapidly and efficiently restoring the affected loads. This paper proposes a multi-agent reinforcement learning method for distribution system restoration. Firstly, considering that the topology of the distribution system may change during network reconfiguration, a dynamic agent network (DAN) architecture is designed to address the challenge of input dimensions changing in neural network. Two encoders are created to capture observations of the environment and other agents respectively, and an attention mechanism is used to aggregate an arbitrary-sized neighboring agent feature set. Then, considering the operation constraints of the DSR, an action mask mechanism is implemented to filter out invalid actions, ensuring the security of the strategy. Finally, an IEEE 123-node test system is used for validation, and the experimental results showed that the proposed algorithm can effectively assist agents in accomplishing collaborative DSR tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Train rescheduling method based on multi-agent reinforcement learning
    Cao, Yuli
    Xu, Zhongwei
    Mei, Meng
    2022 IEEE 6TH ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2022, : 301 - 305
  • [32] Multi-Agent Reinforcement Learning With Distributed Targeted Multi-Agent Communication
    Xu, Chi
    Zhang, Hui
    Zhang, Ya
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 2915 - 2920
  • [33] WRFMR: A Multi-Agent Reinforcement Learning Method for Cooperative Tasks
    Liu, Hui
    Zhang, Zhen
    Wang, Dongqing
    IEEE ACCESS, 2020, 8 : 216320 - 216331
  • [34] A Multi-Agent Reinforcement Learning Based Control Method for CAVs in a Mixed Platoon
    Xu, Yaqi
    Shi, Yan
    Tong, Xiaolu
    Chen, Shanzhi
    Ge, Yuming
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (11) : 16160 - 16172
  • [35] Skill matters: Dynamic skill learning for multi-agent cooperative reinforcement learning
    Li, Tong
    Bai, Chenjia
    Xu, Kang
    Chu, Chen
    Zhu, Peican
    Wang, Zhen
    NEURAL NETWORKS, 2025, 181
  • [36] Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning
    Wu, Zhi
    Li, Yiqi
    Gu, Wei
    Dong, Zengbo
    Zhao, Jingtao
    Liu, Weiliang
    Zhang, Xiao-Ping
    Liu, Pengxiang
    Sun, Qirun
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 147
  • [37] Multi-agent Deep Reinforcement Learning collaborative Traffic Signal Control method considering intersection heterogeneity
    Bie, Yiming
    Ji, Yuting
    Ma, Dongfang
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 164
  • [38] Learning to Routing in UAV Swarm Network: A Multi-Agent Reinforcement Learning Approach
    Wang, Zunliang
    Yao, Haipeng
    Mai, Tianle
    Xiong, Zehui
    Wu, Xiaohua
    Wu, Di
    Guo, Song
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (05) : 6611 - 6624
  • [39] A Multi-Agent Reinforcement Learning Method for Cooperative Secondary Voltage Control of Microgrids
    Wang, Tianhao
    Ma, Shiqian
    Tang, Zhuo
    Xiang, Tianchun
    Mu, Chaoxu
    Jin, Yao
    ENERGIES, 2023, 16 (15)
  • [40] Multi-Agent Reinforcement Learning Enabling Dynamic Pricing Policy for Charging Station Operators
    Han, Ye
    Zhang, Xuefei
    Zhang, Jian
    Cui, Qimei
    Wang, Shuo
    Han, Zhu
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,