A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration

被引:3
|
作者
Si, Ruiqi [1 ]
Chen, Siyuan [1 ]
Zhang, Jun [1 ]
Xu, Jian [1 ]
Zhang, Luxi [2 ]
机构
[1] Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China
[2] Brandeis Univ, Waltham, MA 02454 USA
基金
国家重点研发计划;
关键词
Deep reinforcement learning; Multi-agent reinforcement learning; Distribution system restoration; Distribution network; Microgrid; UNBALANCED DISTRIBUTION-SYSTEMS; SERVICE RESTORATION; MANAGEMENT; MODEL;
D O I
10.1016/j.apenergy.2024.123625
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Extreme weather, chain failures, and other events have increased the probability of wide-area blackouts, which highlights the importance of rapidly and efficiently restoring the affected loads. This paper proposes a multi-agent reinforcement learning method for distribution system restoration. Firstly, considering that the topology of the distribution system may change during network reconfiguration, a dynamic agent network (DAN) architecture is designed to address the challenge of input dimensions changing in neural network. Two encoders are created to capture observations of the environment and other agents respectively, and an attention mechanism is used to aggregate an arbitrary-sized neighboring agent feature set. Then, considering the operation constraints of the DSR, an action mask mechanism is implemented to filter out invalid actions, ensuring the security of the strategy. Finally, an IEEE 123-node test system is used for validation, and the experimental results showed that the proposed algorithm can effectively assist agents in accomplishing collaborative DSR tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] A Two-Stage Multi-Agent Deep Reinforcement Learning Method for Urban Distribution Network Reconfiguration Considering Switch Contribution
    Gao, Hongjun
    Jiang, Siyuan
    Li, Zhengmao
    Wang, Renjun
    Liu, Youbo
    Liu, Junyong
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (06) : 7064 - 7076
  • [2] Multi-Agent Reinforcement Learning for Distribution System Critical Load Restoration
    Yao, Yiyun
    Zhang, Xiangyu
    Wang, Jiyu
    Ding, Fei
    2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, 2023,
  • [3] A novel approach for dynamic reconfiguration of the distribution network via multi-agent system
    Li, Zhenkun
    Chen, Xingying
    Yu, Kun
    Zhao, Bo
    Liu, Haoming
    2008 THIRD INTERNATIONAL CONFERENCE ON ELECTRIC UTILITY DEREGULATION AND RESTRUCTURING AND POWER TECHNOLOGIES, VOLS 1-6, 2008, : 1305 - 1311
  • [4] A Method for Solving Reconfiguration Blueprints Based on Multi-Agent Reinforcement Learning
    Cheng, Jing
    Tan, Wen
    Lv, Guangzhe
    Li, Guodong
    Zhang, Wentao
    Liu, Zihao
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2024, 21 (04)
  • [5] A multi-agent system for distribution network restoration in future smart grids
    Al-Hinai, Amer
    Alhelou, Hassan Haes
    ENERGY REPORTS, 2021, 7 : 8083 - 8090
  • [6] System Service Restoration of Distribution Network Based on Multi-Agent Technology
    Chen, Xiaojing
    Kong, Bing
    Liu, Fan
    Gong, Xue
    Shen, Xia
    2013 FOURTH INTERNATIONAL CONFERENCE ON DIGITAL MANUFACTURING AND AUTOMATION (ICDMA), 2013, : 1371 - 1374
  • [7] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Kundacina, Ognjen B.
    Vidovic, Predrag M.
    Petkovic, Milan R.
    ELECTRICAL ENGINEERING, 2022, 104 (03) : 1487 - 1501
  • [8] Solving dynamic distribution network reconfiguration using deep reinforcement learning
    Ognjen B. Kundačina
    Predrag M. Vidović
    Milan R. Petković
    Electrical Engineering, 2022, 104 : 1487 - 1501
  • [9] Safe Multi-Agent Deep Reinforcement Learning for Dynamic Virtual Network Allocation
    Suzuki, Akito
    Harada, Shigeaki
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [10] Multi-Agent Deep Reinforcement Learning for Distributed Load Restoration
    Linh Vu
    Tuyen Vu
    Thanh Long Vu
    Srivastava, Anurag
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (02) : 1749 - 1760