MADDPG-Based Active Distribution Network Dynamic Reconfiguration with Renewable Energy

被引:5
作者
Jiang, Changxu [1 ]
Lin, Zheng [1 ]
Liu, Chenxi [1 ]
Chen, Feixiong [1 ]
Shao, Zhenguo [1 ]
机构
[1] Fuzhou Univ, Sch Elect Engn & Automat, Fuzhou 350108, Peoples R China
基金
中国国家自然科学基金;
关键词
Uncertainty; Heuristic algorithms; Power system dynamics; Distribution networks; Power system stability; Mathematical models; Encoding; Real-time systems; Optimization; Load modeling; Distribution network reconfiguration; active distribution network; deep deterministic policy gradient; multi-agent deep reinforcement learning; DISTRIBUTION-SYSTEMS; GENETIC ALGORITHM;
D O I
10.23919/PCMP.2023.000283
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The integration of distributed generations (DG), such as wind turbines and photovoltaics, has a significant impact on the security, stability, and economy of the distribution network due to the randomness and fluctuations of DG output. Dynamic distribution network reconfiguration (DNR) technology has the potential to mitigate this problem effectively. However, due to the non-convex and nonlinear characteristics of the DNR model, traditional mathematical optimization algorithms face speed challenges, and heuristic algorithms struggle with both speed and accuracy. These problems hinder the effective control of existing distribution networks. To address these challenges, an active distribution network dynamic reconfiguration approach based on an improved multi-agent deep deterministic policy gradient (MADDPG) is proposed. Firstly, taking into account the uncertainties of load and DG, a dynamic DNR stochastic mathematical model is constructed. Next, the concept of fundamental loops (FLs) is defined and the coding method based on loop-coding is adopted for MADDPG action space. Then, the agents with actor and critic networks are equipped in each FL to real-time control network topology. Subsequently, a MADDPG framework for dynamic DNR is constructed. Finally, simulations are conducted on an improved IEEE 33-bus power system to validate the superiority of MADDPG. The results demonstrate that MADDPG has a shorter calculation time than the heuristic algorithm and mathematical optimization algorithm, which is useful for real-time control of DNR.
引用
收藏
页码:143 / 155
页数:13
相关论文
共 24 条
[1]   Distribution network reconfiguration using a genetic algorithm with varying population size [J].
Abdelaziz, Morad .
ELECTRIC POWER SYSTEMS RESEARCH, 2017, 142 :9-11
[2]   NETWORK RECONFIGURATION IN DISTRIBUTION-SYSTEMS FOR LOSS REDUCTION AND LOAD BALANCING [J].
BARAN, ME ;
WU, FF .
IEEE TRANSACTIONS ON POWER DELIVERY, 1989, 4 (02) :1401-1407
[3]   Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices [J].
Cao, Di ;
Hu, Weihao ;
Xu, Xiao ;
Wu, Qiuwei ;
Huang, Qi ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2021, 9 (05) :1101-1110
[4]  
Chen H., 2024, Applied Energy, V357, P1
[5]   Value of Distribution Network Reconfiguration in Presence of Renewable Energy Resources [J].
Dorostkar-Ghamsari, Mohammad Reza ;
Fotuhi-Firuzabad, Mahmud ;
Lehtonen, Matti ;
Safdarian, Amir .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2016, 31 (03) :1879-1888
[6]   A New Hybrid Particle Swarm Optimization and Genetic Algorithm Method Controlled by Fuzzy Logic [J].
Dziwinski, Piotr ;
Bartczuk, Lukasz .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2020, 28 (06) :1140-1154
[7]   Toward Optimal Multiperiod Network Reconfiguration for Increasing the Hosting Capacity of Distribution Networks [J].
Fu, Yang-Yang ;
Chiang, Hsiao-Dong .
IEEE TRANSACTIONS ON POWER DELIVERY, 2018, 33 (05) :2294-2304
[8]   A Comparative Study of Reinforcement Learning Algorithms for Distribution Network Reconfiguration With Deep Q-Learning-Based Action Sampling [J].
Gholizadeh, Nastaran ;
Kazemi, Nazli ;
Musilek, Petr .
IEEE ACCESS, 2023, 11 :13714-13723
[9]   Impacts of Integrating Topology Reconfiguration and Vehicle-to-Grid Technologies on Distribution System Operation [J].
Guo, Zhaomiao ;
Zhou, Zhi ;
Zhou, Yan .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2020, 11 (02) :1023-1032
[10]   Parallel inverter control using different conventional control methods and an improved virtual oscillator control method in a standalone microgrid [J].
Gurugubelli, Vikash ;
Ghosh, Arnab ;
Panda, Anup Kumar .
PROTECTION AND CONTROL OF MODERN POWER SYSTEMS, 2022, 7 (01)