Explainable reinforcement learning for distribution network reconfiguration

被引:3
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ,2 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB, Canada
[2] Univ Hradec Kralove, Appl Cybernet, Hradec Kralove, Czech Republic
基金
加拿大自然科学与工程研究理事会;
关键词
Distribution network reconfiguration; Reinforcement learning; Deep Q-learning; Data-driven control; Explainable machine learning; DYNAMIC RECONFIGURATION; OPERATION;
D O I
10.1016/j.egyr.2024.05.031
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The lack of transparency in reinforcement learning methods' decision-making process has resulted in a significant lack of trust towards these models, subsequently limiting their utilization in critical decisionmaking applications. The use of reinforcement learning in distribution network reconfiguration is an inherently sensitive application due to the need to change the states of the switches, which can significantly impact the lifespan of the switches. Consequently, executing this process requires meticulous and deliberate consideration. This study presents a new methodology to analyze and elucidate reinforcement learning-based decisions in distribution network reconfiguration. The proposed approach involves the training of an explainer neural network based on the decisions of the reinforcement learning agent. The explainer network receives as input the active and reactive power of the buses at each hour and outputs the line states determined by the agent. To delve deeper into the inner workings of the explainer network, attribution methods are employed. These techniques facilitate the examination of the intricate relationship between the inputs and outputs of the network, offering valuable insights into the agent's decision-making process. The efficacy of this novel approach is demonstrated through its application to both the 33- and 136 -bus test systems, and the obtained results are presented.
引用
收藏
页码:5703 / 5715
页数:13
相关论文
共 50 条
  • [41] Network Reconfiguration at the Distribution System with Distributed Generators
    Gao Xiaozhi
    Li Linchuan
    Xue Hailong
    LIFE SYSTEM MODELING AND INTELLIGENT COMPUTING, PT II, 2010, 6329 : 400 - 409
  • [42] Analysis on the impact of DG on distribution network reconfiguration
    Li, P. (lip@tju.edu.cn), 1600, Tianjin University (47): : 189 - 194
  • [43] Distribution Network Reconfiguration in the Presence of Harmonic Loads: Optimization Techniques and Analysis
    Jazebi, Saeed
    Hadji, Moosa Moghimi
    Naghizadeh, Ramezan Ali
    IEEE TRANSACTIONS ON SMART GRID, 2014, 5 (04) : 1929 - 1937
  • [44] Optimal PMU Placement in a Distribution Network Considering Network Reconfiguration
    Abdelsalam, Hany A.
    Abdelaziz, Almoataz Y.
    Mukherjee, V.
    2014 IEEE INTERNATIONAL CONFERENCE ON CIRCUIT, POWER AND COMPUTING TECHNOLOGIES (ICCPCT-2014), 2014, : 191 - 196
  • [45] Network Reconfiguration for Loss Reduction in Distribution Network with Distributed Generation
    Ruan, Bo
    Chen, Xi
    Huang, Jun
    Mei, Zhen
    Li, Yu
    2016 IEEE INTERNATIONAL CONFERENCE ON POWER AND RENEWABLE ENERGY (ICPRE), 2016, : 446 - 450
  • [46] Overview on Distribution Network Reconfiguration Optimization Algorithm
    Li, Chuanjian
    Yu, Nanhua
    Chen, Hui
    Zheng, Wenjie
    ELECTRICAL POWER & ENERGY SYSTEMS, PTS 1 AND 2, 2012, 516-517 : 1400 - +
  • [47] Real-time autonomous dynamic reconfiguration based on deep learning algorithm for distribution network
    Ji, Xingquan
    Yin, Ziyang
    Zhang, Yumin
    Xu, Bo
    Liu, Qi
    ELECTRIC POWER SYSTEMS RESEARCH, 2021, 195
  • [48] Continuous Reactive Power Optimization of Distribution Network Using Deep Reinforcement Learning
    Li Q.
    Qiao Y.
    Zhang Y.
    Dianwang Jishu/Power System Technology, 2020, 44 (04): : 1473 - 1480
  • [49] Explainable reinforcement learning in production control of job shop manufacturing system
    Kuhnle, Andreas
    May, Marvin Carl
    Schaefer, Louis
    Lanza, Gisela
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2022, 60 (19) : 5812 - 5834
  • [50] Interestingness elements for explainable reinforcement learning: Understanding agents' capabilities and limitations
    Sequeira, Pedro
    Gervasio, Melinda
    ARTIFICIAL INTELLIGENCE, 2020, 288 (288)