A Distributed Deep Reinforcement Learning Approach for Reactive Power Optimization of Distribution Networks

被引:1
|
作者
Liao, Jinlin [1 ,2 ,3 ]
Lin, Jia [4 ]
机构
[1] State Grid Fujian Elect Power Co Ltd, Econ Technol Res Inst, Fuzhou 350013, Peoples R China
[2] Distribut Network Planning & Operat Control Techno, Fuzhou 350013, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[4] State Grid Fujian Elect Power Co Ltd, Fuzhou 350001, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Reactive power; Optimization; Distribution networks; Deep reinforcement learning; Real-time systems; Trajectory; Fluctuations; Distributed power generation; Actor-critic; distributed power generation; distribution network; reactive power optimization; distributed deep reinforcement learning; SYSTEM;
D O I
10.1109/ACCESS.2024.3445143
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An actor-critic based distributed deep reinforcement learning approach is proposed to optimize the reactive power of the distribution network under the access of distributed photovoltaics, wind turbines and other power sources. This approach can optimize and dispatch the resources of the distribution network in real time under the change of power output such as distributed photovoltaics and wind turbines, so as to optimize the reactive power of the distribution network. First, this paper builds an optimization model with the objective function of minimizing the reactive power of the distribution network, and considers the operating constraints. Then, the agents of the proposed approach are trained, and the well-trained agents can schedule and optimize the resources of the distribution network in real time. Finally, based on the actual source-load output data in a certain place, reactive power optimization simulation experiments are carried out on the IEEE 33-bus, IEEE 123-bus simulation systems and the actual power distribution system in a region of China. Simulation results show that the proposed distributed deep reinforcement learning approach (DDRLA) can optimize distribution network reactive power online in real time.
引用
收藏
页码:113898 / 113909
页数:12
相关论文
共 50 条
  • [1] Distributed Reactive Power Optimization for Energy Internet via Multiagent Deep Reinforcement Learning With Graph Attention Networks
    Xu, Shaolong
    Guo, Sheng
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (06) : 8696 - 8706
  • [2] Continuous Reactive Power Optimization of Distribution Network Using Deep Reinforcement Learning
    Li Q.
    Qiao Y.
    Zhang Y.
    Dianwang Jishu/Power System Technology, 2020, 44 (04): : 1473 - 1480
  • [3] Multi-timescale Deep Reinforcement Learning for Reactive Power Optimization of Distribution Network
    Hu D.
    Peng Y.
    Wei W.
    Xiao T.
    Cai T.
    Xi W.
    Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2022, 42 (14): : 5034 - 5044
  • [4] Distributed Caching in Converged Networks: A Deep Reinforcement Learning Approach
    Xiong, Jian
    Fang, Yuzhe
    Cheng, Peng
    Shi, Zhiping
    Zhang, Wei
    IEEE TRANSACTIONS ON BROADCASTING, 2021, 67 (01) : 201 - 211
  • [5] Reactive Power Optimization Based on Proximal Policy Optimization of Deep Reinforcement Learning
    Zahng P.
    Zhu Z.
    Xie H.
    Dianwang Jishu/Power System Technology, 2023, 47 (02): : 562 - 570
  • [6] A Distributed Reinforcement Learning approach for Power Control in Wireless Networks
    Ornatelli, Antonio
    Tortorelli, Andrea
    Liberati, Francesco
    2021 IEEE WORLD AI IOT CONGRESS (AIIOT), 2021, : 275 - 281
  • [7] A coordinated active and reactive power optimization approach for multi-microgrids connected to distribution networks with multi-actor-attention-critic deep reinforcement learning
    Dong, Lei
    Lin, Hao
    Qiao, Ji
    Zhang, Tao
    Zhang, Shiming
    Pu, Tianjiao
    APPLIED ENERGY, 2024, 373
  • [8] Reactive power optimization in active distribution systems with soft open points based on deep reinforcement learning
    Xiong, Meisong
    Yang, Xiaodong
    Zhang, Youbing
    Wu, Hongbin
    Lin, Yihang
    Wang, Guofeng
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2024, 155
  • [9] Joint Optimization of Spectrum and Power for Vehicular Networks: A MAPPO Based Deep Reinforcement Learning Approach
    Cai, Weiteng
    Huang, Xiujie
    Chen, Yuhao
    Guan, Quanlong
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [10] Reactive Power Optimization for Transient Voltage Stability in Energy Internet via Deep Reinforcement Learning Approach
    Cao, Junwei
    Zhang, Wanlu
    Xiao, Zeqing
    Hua, Haochen
    ENERGIES, 2019, 12 (08)