A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB T6G 1H9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
data-driven control; deep reinforcement learning; distribution network reconfiguration; deep Q-learning; dueling deep Q-learning; DYNAMIC RECONFIGURATION; DISTRIBUTION-SYSTEMS; DATA-DRIVEN; OPTIMIZATION; ENHANCEMENT; DG;
D O I
10.3390/en17205187
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Distribution network reconfiguration (DNR) is used by utilities to enhance power system performance in various ways, such as reducing line losses. Conventional DNR algorithms rely on accurate values of network parameters and lack scalability and optimality. To tackle these issues, a new data-driven algorithm based on reinforcement learning is developed for DNR in this paper. The proposed algorithm comprises two main parts. The first part, named action-space sampling, aims at analyzing the network structure, finding all feasible reconfiguration actions, and reducing the size of the action space to only the most optimal actions. In the second part, deep Q-learning (DQN) and dueling DQN methods are used to train an agent to take the best switching actions according to the switch states and loads of the system. The results show that both DQN and dueling DQN are effective in reducing system losses through grid reconfiguration. The proposed methods have faster execution time compared to the conventional methods and are more scalable.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Comparative Study of Reinforcement Learning Algorithms for Distribution Network Reconfiguration With Deep Q-Learning-Based Action Sampling
    Gholizadeh, Nastaran
    Kazemi, Nazli
    Musilek, Petr
    IEEE ACCESS, 2023, 11 : 13714 - 13723
  • [2] Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning With Large Action Space
    Wei, Fengsheng
    Feng, Gang
    Sun, Yao
    Wang, Yatong
    Qin, Shuang
    Liang, Ying-Chang
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (04): : 2197 - 2211
  • [3] Sequential Reconfiguration of Unbalanced Distribution Network with Soft Open Points Based on Deep Reinforcement Learning
    Yin, Ziyang
    Wang, Shouxiang
    Zhao, Qianyu
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2023, 11 (01) : 107 - 119
  • [4] Reliability-driven distribution power network dynamic reconfiguration in presence of distributed generation by the deep reinforcement learning method
    Malekshah, Soheil
    Rasouli, Ali
    Malekshah, Yaser
    Ramezani, Afsaneh
    Malekshah, Arezoo
    ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (08) : 6541 - 6556
  • [5] Query-based Targeted Action-Space Adversarial Policies on Deep Reinforcement Learning Agents
    Lee, Xian Yeow
    Esfandiari, Yasaman
    Tan, Kai Liang
    Sarkar, Soumik
    ICCPS'21: PROCEEDINGS OF THE 2021 ACM/IEEE 12TH INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS (WITH CPS-IOT WEEK 2021), 2021, : 87 - 97
  • [6] Distribution Network Reconfiguration Using Deep Reinforcement Learning
    Gautam, Mukesh
    Benidris, Mohammed
    2022 17TH INTERNATIONAL CONFERENCE ON PROBABILISTIC METHODS APPLIED TO POWER SYSTEMS (PMAPS), 2022,
  • [7] Self-healing radial distribution network reconfiguration based on deep reinforcement learning
    Jo, Seungchan
    Oh, Jae-Young
    Yoon, Yong Tae
    Jin, Young Gyu
    RESULTS IN ENGINEERING, 2024, 22
  • [8] Real-time operation of distribution network: A deep reinforcement learning-based reconfiguration approach
    Bui, Van-Hai
    Su, Wencong
    SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2022, 50
  • [9] Many-Objective Distribution Network Reconfiguration Via Deep Reinforcement Learning Assisted Optimization Algorithm
    Li, Yuanzheng
    Hao, Guokai
    Liu, Yun
    Yu, Yaowen
    Ni, Zhixian
    Zhao, Yong
    IEEE TRANSACTIONS ON POWER DELIVERY, 2022, 37 (03) : 2230 - 2244
  • [10] Deep Reinforcement Learning Based Approach for Dynamic Optimal Power Flow in Active Distribution Network
    Liu, Xinghua
    Fan, Bangji
    Tian, Jiaqiang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 1951 - 1956