Explainability in Deep Reinforcement Learning: A Review into Current Methods and Applications

被引:13
|
作者
Hickling, Thomas [1 ]
Zenati, Abdelhafid [1 ]
Aouf, Nabil [1 ]
Spencer, Phillippa [2 ]
机构
[1] City Univ London, Dept Elect Engn, Northampton Sq, London EC1V 0HB, England
[2] Def Sci & Technol Lab Dstl, Porton Down, Salisbury SP40JQ, Wilts, England
关键词
Deep reinforcement learning; DRL; Explainable AI; XAI; neural networks; Survey; Review;
D O I
10.1145/3623377
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The use of Deep Reinforcement Learning (DRL) schemes has increased dramatically since their first introduction in 2015. Though uses in many different applications are being found, they still have a problem with the lack of interpretability. This has bread a lack of understanding and trust in the use of DRL solutions from researchers and the general public. To solve this problem, the field of Explainable Artificial Intelligence has emerged. This entails a variety of different methods that look to open the DRL black boxes, ranging from the use of interpretable symbolic Decision Trees to numerical methods like Shapley Values. This review looks at which methods are being used and for which applications. This is done to identify which models are the best suited to each application or if a method is being underutilised.
引用
收藏
页数:35
相关论文
共 50 条
  • [1] Explainability in deep reinforcement learning
    Heuillet, Alexandre
    Couthouis, Fabien
    Diaz-Rodriguez, Natalia
    KNOWLEDGE-BASED SYSTEMS, 2021, 214 (214)
  • [2] Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics
    Mosavi, Amirhosein
    Faghan, Yaser
    Ghamisi, Pedram
    Puhong Duan
    Ardabili, Sina Faizollahzadeh
    Salwana, Ely
    Band, Shahab S.
    MATHEMATICS, 2020, 8 (10)
  • [3] Explainability of Deep Reinforcement Learning Method with Drones
    Cetin, Ender
    Barrado, Cristina
    Pastor, Enric
    2023 IEEE/AIAA 42ND DIGITAL AVIONICS SYSTEMS CONFERENCE, DASC, 2023,
  • [4] A Comparison of Saliency Methods for Deep Learning Explainability
    Konate, Salamata
    Lebrat, Leo
    Santa Cruz, Rodrigo
    Smith, Elliot
    Bradley, Andrew
    Fookes, Clinton
    Salvado, Olivier
    2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 454 - 461
  • [5] Applications of deep reinforcement learning in nuclear energy: A review
    Liu, Yongchao
    Wang, Bo
    Tan, Sichao
    Li, Tong
    Lv, Wei
    Niu, Zhenfeng
    Li, Jiangkuan
    Gao, Puzhen
    Tian, Ruifeng
    NUCLEAR ENGINEERING AND DESIGN, 2024, 429
  • [6] A Review of Safe Reinforcement Learning: Methods, Theories, and Applications
    Gu, Shangding
    Yang, Long
    Du, Yali
    Chen, Guang
    Walter, Florian
    Wang, Jun
    Knoll, Alois
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 11216 - 11235
  • [7] A Review on Methods and Applications in Multimodal Deep Learning
    Jabeen, Summaira
    Li, Xi
    Amin, Muhammad Shoib
    Bourahla, Omar
    Li, Songyuan
    Jabbar, Abdul
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [8] HEX: Human-in-the-loop explainability via deep reinforcement learning
    Lash, Michael T.
    DECISION SUPPORT SYSTEMS, 2024, 187
  • [9] Assessing Explainability in Reinforcement Learning
    ZeIvelder, Amber E.
    Westberg, Marcus
    Framling, Kary
    EXPLAINABLE AND TRANSPARENT AI AND MULTI-AGENT SYSTEMS, EXTRAAMAS 2021, 2021, 12688 : 223 - 240
  • [10] A Review of Deep Reinforcement Learning Methods and Military Application Research
    Wang, Ning
    Li, Zhe
    Liang, Xiaolong
    Hou, Yueqi
    Yang, Aiwu
    Mathematical Problems in Engineering, 2023, 2023