A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration

被引:3
|
作者
Si, Ruiqi [1 ]
Chen, Siyuan [1 ]
Zhang, Jun [1 ]
Xu, Jian [1 ]
Zhang, Luxi [2 ]
机构
[1] Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China
[2] Brandeis Univ, Waltham, MA 02454 USA
基金
国家重点研发计划;
关键词
Deep reinforcement learning; Multi-agent reinforcement learning; Distribution system restoration; Distribution network; Microgrid; UNBALANCED DISTRIBUTION-SYSTEMS; SERVICE RESTORATION; MANAGEMENT; MODEL;
D O I
10.1016/j.apenergy.2024.123625
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Extreme weather, chain failures, and other events have increased the probability of wide-area blackouts, which highlights the importance of rapidly and efficiently restoring the affected loads. This paper proposes a multi-agent reinforcement learning method for distribution system restoration. Firstly, considering that the topology of the distribution system may change during network reconfiguration, a dynamic agent network (DAN) architecture is designed to address the challenge of input dimensions changing in neural network. Two encoders are created to capture observations of the environment and other agents respectively, and an attention mechanism is used to aggregate an arbitrary-sized neighboring agent feature set. Then, considering the operation constraints of the DSR, an action mask mechanism is implemented to filter out invalid actions, ensuring the security of the strategy. Finally, an IEEE 123-node test system is used for validation, and the experimental results showed that the proposed algorithm can effectively assist agents in accomplishing collaborative DSR tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Deep reinforcement learning for multi-agent interaction
    Ahmed, Ibrahim H.
    Brewitt, Cillian
    Carlucho, Ignacio
    Christianos, Filippos
    Dunion, Mhairi
    Fosong, Elliot
    Garcin, Samuel
    Guo, Shangmin
    Gyevnar, Balint
    McInroe, Trevor
    Papoudakis, Georgios
    Rahman, Arrasy
    Schafer, Lukas
    Tamborski, Massimiliano
    Vecchio, Giuseppe
    Wang, Cheng
    Albrecht, Stefano, V
    AI COMMUNICATIONS, 2022, 35 (04) : 357 - 368
  • [22] A New Multi-Agent Reinforcement Learning Method Based on Evolving Dynamic Correlation Matrix
    Gan, Xingli
    Guo, Hongliang
    Li, Zhan
    IEEE ACCESS, 2019, 7 : 162127 - 162138
  • [23] Multi-agent reinforcement learning based textile dyeing workshop dynamic scheduling method
    He J.
    Zhang J.
    Zhang P.
    Zheng P.
    Wang M.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2023, 29 (01): : 61 - 74
  • [24] Traffic Distribution Algorithm Based on Multi-Agent Reinforcement Learning
    Cheng C.
    Teng J.-J.
    Zhao Y.-L.
    Song M.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2019, 42 (06): : 43 - 48and57
  • [25] Dynamic Reconfiguration Method of Active Distribution Networks Based on Graph Attention Network Reinforcement Learning
    Guo, Chen
    Jiang, Changxu
    Liu, Chenxi
    ENERGIES, 2025, 18 (08)
  • [26] Reinforcement Learning Scheme for Grouping and Characterization of Multi-agent Network
    Morihiro, Koichiro
    Matsui, Nobuyuki
    Isokawa, Teijiro
    Nishimura, Haruhiko
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT III, 2010, 6278 : 592 - +
  • [27] Batch-Constrained Reinforcement Learning for Dynamic Distribution Network Reconfiguration
    Gao, Yuanqi
    Wang, Wei
    Shi, Jie
    Yu, Nanpeng
    IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (06) : 5357 - 5369
  • [28] A Multi-Agent Reinforcement Learning Architecture for Network Slicing Orchestration
    Mason, Federico
    Nencioni, Gianfranco
    Zanella, Andrea
    2021 19TH MEDITERRANEAN COMMUNICATION AND COMPUTER NETWORKING CONFERENCE (MEDCOMNET), 2021,
  • [29] ADVERSARIAL MULTI-AGENT REINFORCEMENT LEARNING ALGORITHM FOR ANOMALY NETWORK INTRUSION DETECTION SYSTEM
    Mohamed, Safa
    Ejbali, Ridha
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2021, 13 (03): : 87 - 102
  • [30] Multi-Agent Deep Q Network to Enhance the Reinforcement Learning for Delayed Reward System
    Kim, Keecheon
    APPLIED SCIENCES-BASEL, 2022, 12 (07):