Voltage Control Strategy for Distribution Network Based on Incremental Learning and Knowledge Fusion

被引:0
作者
Liu, Mengsen [1 ]
Chen, Dan [1 ]
Li, Xiaolu [2 ]
Su, Haotian [2 ]
Zhou, Xiang [2 ]
机构
[1] State Grid Beijing Fengtai Power Supply Co, Beijing, Peoples R China
[2] Shanghai Univ Elect Power, Coll Elect Engn, Shanghai, Peoples R China
来源
12TH INTERNATIONAL CONFERENCE ON SMART GRID, ICSMARTGRID 2024 | 2024年
关键词
distribution network; multi-agent deep reinforcement learning; voltage control strategy; incremental learning; knowledge fusion;
D O I
10.1109/icSmartGrid61824.2024.10578128
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The growing penetration of distributed energy resources and the application of power electronic devices in the distribution network causes difficulty in accurate network models and frequent changes in the topology. The voltage control based on multi-agent deep reinforcement learning has the advantage of obtaining fast model-free solutions. However, traditional multi-agent deep reinforcement learning methods are unsuitable for real-time changing topologies. To enhance the robustness of the agent strategy after topological changes in the distribution network and improve the performance of the agent strategy in the early stages of training, a voltage control strategy based on incremental learning and knowledge fusion for the distribution network is proposed. Firstly, incremental learning is combined with multi-agent deep reinforcement learning to allow agents to retain the memory of old topologies while training on new ones, preventing catastrophic forgetting. Secondly, a knowledge fusion-based agent policy shielding layer is designed to restrict policy adjustments during training. The proposed method ensures good optimization effects under different topologies and improves training efficiency. Finally, the proposed control strategy is verified on the improved IEEE 33-bus distribution system, and the results show that the agent strategy has good optimization performances under a variety of typical topologies and improves training efficiency.
引用
收藏
页码:589 / 596
页数:8
相关论文
共 16 条
  • [1] Rusu AA, 2016, Arxiv, DOI arXiv:1606.04671
  • [2] Pseudo-rehearsal: Achieving deep reinforcement learning without catastrophic forgetting
    Atkinson, Craig
    McCane, Brendan
    Szymanski, Lech
    Robins, Anthony
    [J]. NEUROCOMPUTING, 2021, 428 : 291 - 307
  • [3] A Multi-Agent Deep Reinforcement Learning Based Voltage Regulation Using Coordinated PV Inverters
    Cao, Di
    Hu, Weihao
    Zhao, Junbo
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (05) : 4120 - 4123
  • [4] Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
    Chen, Xin
    Qu, Guannan
    Tang, Yujie
    Low, Steven
    Li, Na
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (04) : 2935 - 2958
  • [5] A Continual Learning Survey: Defying Forgetting in Classification Tasks
    De Lange, Matthias
    Aljundi, Rahaf
    Masana, Marc
    Parisot, Sarah
    Jia, Xu
    Leonardis, Ales
    Slabaugh, Greg
    Tuytelaars, Tinne
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3366 - 3385
  • [6] Elia Group, 2014, Transparency on grid dataDB/OL
  • [7] Data-Driven Adaptive Operation of Soft Open Points in Active Distribution Networks
    Huo, Yanda
    Li, Peng
    Ji, Haoran
    Yan, Jinyue
    Song, Guanyu
    Wu, Jianzhong
    Wang, Chengshan
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) : 8230 - 8242
  • [8] Li C., 2019, 2019 18 IEEE INT C M, P1930
  • [9] Lillicrap T. P., 2015, arXiv
  • [10] [全欢 Quan Huan], 2023, [电网技术, Power System Technology], V47, P2029