A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB T6G 1H9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
data-driven control; deep reinforcement learning; distribution network reconfiguration; deep Q-learning; dueling deep Q-learning; DYNAMIC RECONFIGURATION; DISTRIBUTION-SYSTEMS; DATA-DRIVEN; OPTIMIZATION; ENHANCEMENT; DG;
D O I
10.3390/en17205187
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Distribution network reconfiguration (DNR) is used by utilities to enhance power system performance in various ways, such as reducing line losses. Conventional DNR algorithms rely on accurate values of network parameters and lack scalability and optimality. To tackle these issues, a new data-driven algorithm based on reinforcement learning is developed for DNR in this paper. The proposed algorithm comprises two main parts. The first part, named action-space sampling, aims at analyzing the network structure, finding all feasible reconfiguration actions, and reducing the size of the action space to only the most optimal actions. In the second part, deep Q-learning (DQN) and dueling DQN methods are used to train an agent to take the best switching actions according to the switch states and loads of the system. The results show that both DQN and dueling DQN are effective in reducing system losses through grid reconfiguration. The proposed methods have faster execution time compared to the conventional methods and are more scalable.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] A Cloud-Edge Collaboration Solution for Distribution Network Reconfiguration Using Multi-Agent Deep Reinforcement Learning
    Gao, Hongjun
    Wang, Renjun
    He, Shuaijia
    Wang, Lingfeng
    Liu, Junyong
    Chen, Zhe
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 3867 - 3879
  • [42] Deep Reinforcement Learning-Based Voltage Control to Deal with Model Uncertainties in Distribution Networks
    Toubeau, Jean-Francois
    Zad, Bashir Bakhshideh
    Hupez, Martin
    De Greve, Zacharie
    Vallee, Francois
    ENERGIES, 2020, 13 (15)
  • [43] A Neural Network based Deep Reinforcement Learning Controller for Voltage Regulation of Active Distribution Network
    Jain, Jatin
    Mohamed, Ahmed
    Rahman, Tanvir
    Ali, Mohamed
    2024 IEEE 5TH ANNUAL WORLD AI IOT CONGRESS, AIIOT 2024, 2024, : 0280 - 0285
  • [44] Optimization of a Redox-Flow Battery Simulation Model Based on a Deep Reinforcement Learning Approach
    Ben Ahmed, Mariem
    Hassen, Wiem Fekih
    BATTERIES-BASEL, 2024, 10 (01):
  • [45] An Improved Beetle Swarm Algorithm Based on Social Learning for a Game Model of Multiobjective Distribution Network Reconfiguration
    Chen, Qian
    Wang, Weiqing
    Wang, Haiyun
    Wu, Jiahui
    Wang, Jie
    IEEE ACCESS, 2020, 8 : 200932 - 200952
  • [46] Instant flow distribution network optimization in liquid composite molding using deep reinforcement learning
    Szarski, Martin
    Chauhan, Sunita
    JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (01) : 197 - 218
  • [47] Instant flow distribution network optimization in liquid composite molding using deep reinforcement learning
    Martin Szarski
    Sunita Chauhan
    Journal of Intelligent Manufacturing, 2023, 34 : 197 - 218
  • [48] An Enhanced Deep Reinforcement Learning Algorithm for Decoupling Capacitor Selection in Power Distribution Network Design
    Zhang, Ling
    Huang, Wenchang
    Juang, Jack
    Lin, Hank
    Tseng, Bin-Chyi
    Hwang, Chulsoon
    2020 IEEE INTERNATIONAL SYMPOSIUM ON ELECTROMAGNETIC COMPATIBILITY AND SIGNAL & POWER INTEGRITY VIRTUAL SYMPOSIUM(IEEE EMC+SIPI), 2020, : 245 - 250
  • [49] Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices
    Cao, Di
    Hu, Weihao
    Xu, Xiao
    Wu, Qiuwei
    Huang, Qi
    Chen, Zhe
    Blaabjerg, Frede
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2021, 9 (05) : 1101 - 1110
  • [50] Dynamic power allocation in cellular network based on multi-agent double deep reinforcement learning
    Yang, Yi
    Li, Fenglei
    Zhang, Xinzhe
    Liu, Zhixin
    Chan, Kit Yan
    COMPUTER NETWORKS, 2022, 217