Deciphering Deep Reinforcement Learning: Towards Explainable Decision-Making in Optical Networks

被引:0
|
作者
Bermudez Cedeno, Jorge [1 ]
Pemplefort, Hermann [1 ]
Morales, Patricia [1 ]
Araya, Mauricio [1 ]
Jara, Nicolas [1 ]
机构
[1] UTFSM, Dept Elect Engn, Valparaiso, Chile
来源
2024 IEEE 25TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING, HPSR 2024 | 2024年
关键词
Deep reinforcement learning; explainability; imitation learning;
D O I
10.1109/HPSR62440.2024.10635946
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, applying Deep Reinforcement Learning (DRL) techniques for optical networks has emerged as an innovative approach, imitating human cognitive processes and enabling machines to learn, reason, and make decisions autonomously. However, a significant challenge in implementing these techniques lies in their inherent opacity, often rendering them as 'black box' models, which makes it challenging to comprehend the rationale behind specific actions. Nonetheless, actions must be taken as clearly as possible for effective control and resource management decisions in optical networks. This paper is dedicated to addressing this challenge by providing a framework for generating comprehensive explanations based on the decision-making process of DRL agents. We employ imitation learning to train a random forest classifier to achieve interpretability, leveraging insights from a robust reinforcement learning non-linear agent tailored for elastic optical networks. Through this approach, we attain a level of explainability that empowers us to decipher and understand the decisions made by the DRL agent, thus enhancing our ability to manage optical networks effectively.
引用
收藏
页码:80 / 86
页数:7
相关论文
共 50 条
  • [1] Reinforcement learning for decision-making under deep uncertainty
    Pei, Zhihao
    Rojas-Arevalo, Angela M.
    de Haan, Fjalar J.
    Lipovetzky, Nir
    Moallemi, Enayat A.
    JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2024, 359
  • [2] Decision-making method for air combat maneuver based on explainable reinforcement learning
    Yang, Shuheng
    Zhang, Dong
    Xiong, Wei
    Ren, Zhi
    Tang, Shuo
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2024, 45 (18):
  • [3] Explainable, Deep Reinforcement Learning-Based Decision Making for Operations and Maintenance
    Spangler, Ryan M.
    Raeisinezhad, Mahsa
    Cole, Daniel G.
    NUCLEAR TECHNOLOGY, 2024, 210 (12) : 2331 - 2345
  • [4] Towards Explainable Reinforcement Learning in Optical Networks: The RMSA Use Case
    Ayoub, Omran
    Natalino, Carlos
    Monti, Paolo
    2024 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION, OFC, 2024,
  • [5] SPACECRAFT DECISION-MAKING AUTONOMY USING DEEP REINFORCEMENT LEARNING
    Harris, Andrew
    Teil, Thibaud
    Schaub, Hanspeter
    SPACEFLIGHT MECHANICS 2019, VOL 168, PTS I-IV, 2019, 168 : 1757 - 1775
  • [6] Deep Learning and Neural Networks: Decision-Making Implications
    Taherdoost, Hamed
    SYMMETRY-BASEL, 2023, 15 (09):
  • [7] Reinforcement learning with hierarchical decision-making
    Cohen, Shahar
    Maimon, Oded
    Khmlenitsky, Evgeni
    ISDA 2006: SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 3, 2006, : 177 - +
  • [8] Improved deep reinforcement learning for car-following decision-making
    Yang, Xiaoxue
    Zou, Yajie
    Zhang, Hao
    Qu, Xiaobo
    Chen, Lei
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 624
  • [9] Research on Autonomous Decision-Making of UCAV Based on Deep Reinforcement Learning
    Wang, Linxiang
    Wei, Hongtao
    2022 3RD INFORMATION COMMUNICATION TECHNOLOGIES CONFERENCE (ICTC 2022), 2022, : 122 - 126
  • [10] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Guofa Li
    Shenglong Li
    Shen Li
    Yechen Qin
    Dongpu Cao
    Xingda Qu
    Bo Cheng
    Automotive Innovation, 2020, 3 : 374 - 385