Graph-Based Topological Embedding and Deep Reinforcement Learning for Autonomous Voltage Control in Power System

被引:0
|
作者
Wei, Hongtao [1 ]
Chang, Siyu [1 ]
Zhang, Jiaming [1 ]
机构
[1] Wuhan Univ Technol, Coll Informat Engn, Wuhan 430070, Peoples R China
关键词
deep reinforcement learning (DRL); Graph Convolutional Network (GCN); soft actor-critic (SAC); voltage control; load shedding;
D O I
10.3390/s25030733
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With increasing power system complexity and distributed energy penetration, traditional voltage control methods struggle with dynamic changes and complex conditions. While existing deep reinforcement learning (DRL) methods have advanced grid control, challenges persist in leveraging topological features and ensuring computational efficiency. To address these issues, this paper proposes a DRL method combining Graph Convolutional Networks (GCNs) and soft actor-critic (SAC) for voltage control through load shedding. The method uses GCNs to extract higher-order topological features of the power grid, enhancing the state representation capability, while the SAC optimizes the load shedding strategy in continuous action space, dynamically adjusting the control scheme to balance load shedding costs and voltage stability. Results from the simulation of the IEEE 39-bus system indicate that the proposed method significantly reduces the amount of load shedding, improves voltage recovery levels, and demonstrates strong control performance and robustness when dealing with complex disturbances and topological changes. This study provides an innovative solution to voltage control problems in smart grids.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Graph-based Deep Reinforcement Learning Framework for Autonomous Power Dispatch on Power Systems with Changing Topologies
    Zhao, Yu
    Liu, Jun
    Liu, Xiaoming
    Yuan, Keyu
    Ren, Kezheng
    Yang, Mengqin
    2022 IEEE SUSTAINABLE POWER AND ENERGY CONFERENCE (ISPEC), 2022,
  • [2] Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
    Duan, Jiajun
    Shi, Di
    Diao, Ruisheng
    Li, Haifeng
    Wang, Zhiwei
    Zhang, Bei
    Bian, Desong
    Yi, Zhehan
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (01) : 814 - 817
  • [3] Graph Attention Network Based Deep Reinforcement Learning for Voltage/var Control of Topologically Variable Power System
    Xiaofei Liu
    Pei Zhang
    Hua Xie
    Xuegang Lu
    Xiangyu Wu
    Zhao Liu
    Journal of Modern Power Systems and Clean Energy, 2025, 13 (01) : 215 - 227
  • [4] Graph Attention Network Based Deep Reinforcement Learning for Voltage/var Control of Topologically Variable Power System
    Liu, Xiaofei
    Zhang, Pei
    Xie, Hua
    Lu, Xuegang
    Wu, Xiangyu
    Liu, Zhao
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2025, 13 (01) : 215 - 227
  • [5] Deep Reinforcement Learning Based Autonomous Control Approach for Power System Topology Optimization
    Han, Xiaoyun
    Hao, Yi
    Chong, Zhiqiang
    Ma, Shiqiang
    Mu, Chaoxu
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6041 - 6046
  • [6] iADA*-RL: Anytime Graph-Based Path Planning with Deep Reinforcement Learning for an Autonomous UAV
    Maw, Aye Aye
    Tyan, Maxim
    Nguyen, Tuan Anh
    Lee, Jae-Woo
    APPLIED SCIENCES-BASEL, 2021, 11 (09):
  • [7] Enhancing the Tolerance of Voltage Regulation to Cyber Contingencies via Graph-Based Deep Reinforcement Learning
    Zhao, Yu
    Liu, Jun
    Liu, Xiaoming
    Yuan, Keyu
    Ding, Tao
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 4661 - 4673
  • [8] Asymmetric Graph-Based Deep Reinforcement Learning for Portfolio Optimization
    Sun, Haoyu
    Liu, Xin
    Bian, Yuxuan
    Zhu, Peng
    Cheng, Dawei
    Liang, Yuqi
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES-APPLIED DATA SCIENCE TRACK, PT IX, ECML PKDD 2024, 2024, 14949 : 174 - 189
  • [9] DeepMigration: Flow Migration for NFV with Graph-based Deep Reinforcement Learning
    Sun, Penghao
    Lan, Julong
    Guo, Zehua
    Zhang, Di
    Chen, Xianfu
    Hu, Yuxiang
    Liu, Zhi
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [10] An autonomous control technology based on deep reinforcement learning for optimal active power dispatch
    Han, Xiaoyun
    Mu, Chaoxu
    Yan, Jun
    Niu, Zeyuan
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 145