A Generalized Deep Reinforcement Learning Model for Distribution Network Reconfiguration with Power Flow-Based Action-Space Sampling

被引:0
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB T6G 1H9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
data-driven control; deep reinforcement learning; distribution network reconfiguration; deep Q-learning; dueling deep Q-learning; DYNAMIC RECONFIGURATION; DISTRIBUTION-SYSTEMS; DATA-DRIVEN; OPTIMIZATION; ENHANCEMENT; DG;
D O I
10.3390/en17205187
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Distribution network reconfiguration (DNR) is used by utilities to enhance power system performance in various ways, such as reducing line losses. Conventional DNR algorithms rely on accurate values of network parameters and lack scalability and optimality. To tackle these issues, a new data-driven algorithm based on reinforcement learning is developed for DNR in this paper. The proposed algorithm comprises two main parts. The first part, named action-space sampling, aims at analyzing the network structure, finding all feasible reconfiguration actions, and reducing the size of the action space to only the most optimal actions. In the second part, deep Q-learning (DQN) and dueling DQN methods are used to train an agent to take the best switching actions according to the switch states and loads of the system. The results show that both DQN and dueling DQN are effective in reducing system losses through grid reconfiguration. The proposed methods have faster execution time compared to the conventional methods and are more scalable.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Deep Reinforcement Learning Based Charging Scheduling for Household Electric Vehicles in Active Distribution Network
    Qi, Taoyi
    Ye, Chengjin
    Zhao, Yuming
    Li, Lingyang
    Ding, Yi
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2023, 11 (06) : 1890 - 1901
  • [32] INTEGRATED ACTIVE-REACTIVE POWER DISPATCHING MODEL BASED ON DEEP REINFORCEMENT LEARNING
    Lin, Zizhao
    Liu, Xuefei
    Tian, Qidong
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2022, 84 (01): : 297 - 316
  • [33] A Network Reconfiguration Method for Three-phase Distribution Network using Simplified Power Flow Model
    Wu, Yue
    Wang, Jiarui
    Li, Dexin
    2018 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2018, : 1573 - 1578
  • [34] Proxemics-based deep reinforcement learning for robot navigation in continuous action space
    Cimurs R.
    Suh I.-H.
    Journal of Institute of Control, Robotics and Systems, 2020, 26 (03) : 168 - 176
  • [35] Intelligent rush repair of unmanned distribution network based on deep reinforcement learning
    Zhao, Yue
    Chuan, Yang
    Pu, Shi
    Han, Xuwen
    Xia, Shiyu
    Xie, Yanqi
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 996 - 1000
  • [36] Voltage Control for Active Distribution Network Based on Bayesian Deep Reinforcement Learning
    Zhang, Xiao
    Wu, Zhi
    Zheng, Shu
    Gu, Wei
    Hu, Bo
    Dong, Jichao
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2024, 48 (20): : 81 - 90
  • [37] Bayesian Learning-Based Multi-Objective Distribution Power Network Reconfiguration
    Zhong, Tianwei
    Zhang, Hai-Tao
    Li, Yuanzheng
    Liu, Lan
    Lu, Renzhi
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (02) : 1174 - 1184
  • [38] Abnormal flow detection in industrial control network based on deep reinforcement learning
    Wang, Weiping
    Guo, Junjiang
    Wang, Zhen
    Wang, Hao
    Cheng, Jun
    Wang, Chunyang
    Yuan, Manman
    Kurths, Juergen
    Luo, Xiong
    Gao, Yang
    APPLIED MATHEMATICS AND COMPUTATION, 2021, 409 (409)
  • [39] Deep reinforcement learning based power system optimal carbon emission flow
    Qin, Panhao
    Ye, Jingwen
    Hu, Qinran
    Song, Pengfei
    Kang, Pengpeng
    FRONTIERS IN ENERGY RESEARCH, 2022, 10
  • [40] Power System Flow Adjustment and Sample Generation Based on Deep Reinforcement Learning
    Wu, Shuang
    Hu, Wei
    Lu, Zongxiang
    Gu, Yujia
    Tian, Bei
    Li, Hongqiang
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) : 1115 - 1127