Explainability in Deep Reinforcement Learning: A Review into Current Methods and Applications

被引:16
作者
Hickling, Thomas [1 ]
Zenati, Abdelhafid [1 ]
Aouf, Nabil [1 ]
Spencer, Phillippa [2 ]
机构
[1] City Univ London, Dept Elect Engn, Northampton Sq, London EC1V 0HB, England
[2] Def Sci & Technol Lab Dstl, Porton Down, Salisbury SP40JQ, Wilts, England
关键词
Deep reinforcement learning; DRL; Explainable AI; XAI; neural networks; Survey; Review;
D O I
10.1145/3623377
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The use of Deep Reinforcement Learning (DRL) schemes has increased dramatically since their first introduction in 2015. Though uses in many different applications are being found, they still have a problem with the lack of interpretability. This has bread a lack of understanding and trust in the use of DRL solutions from researchers and the general public. To solve this problem, the field of Explainable Artificial Intelligence has emerged. This entails a variety of different methods that look to open the DRL black boxes, ranging from the use of interpretable symbolic Decision Trees to numerical methods like Shapley Values. This review looks at which methods are being used and for which applications. This is done to identify which models are the best suited to each application or if a method is being underutilised.
引用
收藏
页数:35
相关论文
共 50 条
[21]   Review on the Research and Practice of Deep Learning and Reinforcement Learning in Smart Grids [J].
Zhang, Dongxia ;
Han, Xiaoqing ;
Deng, Chunyu .
CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2018, 4 (03) :362-370
[22]   Multi-Agent Deep Reinforcement Learning for Multi-Robot Applications: A Survey [J].
Orr, James ;
Dutta, Ayan .
SENSORS, 2023, 23 (07)
[23]   Deep reinforcement learning-based methods for resource scheduling in cloud computing: a review and future directions [J].
Zhou, Guangyao ;
Tian, Wenhong ;
Buyya, Rajkumar ;
Xue, Ruini ;
Song, Liang .
ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (05)
[24]   Decomposition methods with deep corrections for reinforcement learning [J].
Maxime Bouton ;
Kyle D. Julian ;
Alireza Nakhaei ;
Kikuo Fujimura ;
Mykel J. Kochenderfer .
Autonomous Agents and Multi-Agent Systems, 2019, 33 :330-352
[25]   Decomposition methods with deep corrections for reinforcement learning [J].
Bouton, Maxime ;
Julian, Kyle D. ;
Nakhaei, Alireza ;
Fujimura, Kikuo ;
Kochenderfer, Mykel J. .
AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2019, 33 (03) :330-352
[26]   Overview of Deep Reinforcement Learning Improvements and Applications [J].
Zhang, Junjie ;
Zhang, Cong ;
Chien, Wei-Che .
JOURNAL OF INTERNET TECHNOLOGY, 2021, 22 (02) :239-255
[27]   From Reinforcement Learning to Deep Reinforcement Learning: An Overview [J].
Agostinelli, Forest ;
Hocquet, Guillaume ;
Singh, Sameer ;
Baldi, Pierre .
BRAVERMAN READINGS IN MACHINE LEARNING: KEY IDEAS FROM INCEPTION TO CURRENT STATE, 2018, 11100 :298-328
[28]   Deep Reinforcement Learning Based Mobile Robot Navigation: A Review [J].
Zhu, Kai ;
Zhang, Tao .
TSINGHUA SCIENCE AND TECHNOLOGY, 2021, 26 (05) :674-691
[29]   Deep Learning Applications in Agriculture: A Short Review [J].
Santos, Luis ;
Santos, Filipe N. ;
Oliveira, Paulo Moura ;
Shinde, Pranjali .
FOURTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, ROBOT 2019, VOL 1, 2020, 1092 :139-151
[30]   Deep learning methods and applications for electrical power systems: A comprehensive review [J].
Ozcanli, Asiye K. ;
Yaprakdal, Fatma ;
Baysal, Mustafa .
INTERNATIONAL JOURNAL OF ENERGY RESEARCH, 2020, 44 (09) :7136-7157