Explainable reinforcement learning for distribution network reconfiguration

被引:3
|
作者
Gholizadeh, Nastaran [1 ]
Musilek, Petr [1 ,2 ]
机构
[1] Univ Alberta, Elect & Comp Engn, Edmonton, AB, Canada
[2] Univ Hradec Kralove, Appl Cybernet, Hradec Kralove, Czech Republic
基金
加拿大自然科学与工程研究理事会;
关键词
Distribution network reconfiguration; Reinforcement learning; Deep Q-learning; Data-driven control; Explainable machine learning; DYNAMIC RECONFIGURATION; OPERATION;
D O I
10.1016/j.egyr.2024.05.031
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The lack of transparency in reinforcement learning methods' decision-making process has resulted in a significant lack of trust towards these models, subsequently limiting their utilization in critical decisionmaking applications. The use of reinforcement learning in distribution network reconfiguration is an inherently sensitive application due to the need to change the states of the switches, which can significantly impact the lifespan of the switches. Consequently, executing this process requires meticulous and deliberate consideration. This study presents a new methodology to analyze and elucidate reinforcement learning-based decisions in distribution network reconfiguration. The proposed approach involves the training of an explainer neural network based on the decisions of the reinforcement learning agent. The explainer network receives as input the active and reactive power of the buses at each hour and outputs the line states determined by the agent. To delve deeper into the inner workings of the explainer network, attribution methods are employed. These techniques facilitate the examination of the intricate relationship between the inputs and outputs of the network, offering valuable insights into the agent's decision-making process. The efficacy of this novel approach is demonstrated through its application to both the 33- and 136 -bus test systems, and the obtained results are presented.
引用
收藏
页码:5703 / 5715
页数:13
相关论文
共 50 条
  • [21] Reliability-driven distribution power network dynamic reconfiguration in presence of distributed generation by the deep reinforcement learning method
    Malekshah, Soheil
    Rasouli, Ali
    Malekshah, Yaser
    Ramezani, Afsaneh
    Malekshah, Arezoo
    ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (08) : 6541 - 6556
  • [22] A Cloud-Edge Collaboration Solution for Distribution Network Reconfiguration Using Multi-Agent Deep Reinforcement Learning
    Gao, Hongjun
    Wang, Renjun
    He, Shuaijia
    Wang, Lingfeng
    Liu, Junyong
    Chen, Zhe
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 3867 - 3879
  • [23] Distribution Network Reconfiguration Based on NoisyNet Deep Q-Learning Network
    Wang, Beibei
    Zhu, Hong
    Xu, Honghua
    Bao, Yuqing
    Di, Huifang
    IEEE ACCESS, 2021, 9 : 90358 - 90365
  • [24] Explainable reinforcement learning for powertrain control engineering
    Laflamme, C.
    Doppler, J.
    Palvolgyi, B.
    Dominka, S.
    Viharos, Zs. J.
    Haeussler, S.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 146
  • [25] Memory-Based Explainable Reinforcement Learning
    Cruz, Francisco
    Dazeley, Richard
    Vamplew, Peter
    AI 2019: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, 11919 : 66 - 77
  • [26] Explainable navigation system using fuzzy reinforcement learning
    Bautista-Montesano, Rolando
    Bustamante-Bello, Rogelio
    Ramirez-Mendoza, Ricardo A.
    INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM, 2020, 14 (04): : 1411 - 1428
  • [27] ReCCoVER: Detecting Causal Confusion for Explainable Reinforcement Learning
    Gajcin, Jasmina
    Dusparic, Ivana
    EXPLAINABLE AND TRANSPARENT AI AND MULTI-AGENT SYSTEMS, EXTRAAMAS 2022, 2022, 13283 : 38 - 56
  • [28] Explainable navigation system using fuzzy reinforcement learning
    Rolando Bautista-Montesano
    Rogelio Bustamante-Bello
    Ricardo A. Ramirez-Mendoza
    International Journal on Interactive Design and Manufacturing (IJIDeM), 2020, 14 : 1411 - 1428
  • [29] Pittsburgh Learning Classifier Systems for Explainable Reinforcement Learning: Comparing with XCS
    Bishop, Jordan T.
    Gallagher, Marcus
    Browne, Will N.
    PROCEEDINGS OF THE 2022 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'22), 2022, : 323 - 331
  • [30] A Distributed Algorithm for Distribution Network Reconfiguration
    Gao, Yuanqi
    Wang, Peng
    Yu, Nanpeng
    2018 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED), 2018, : 1730 - 1734