Explainable AI-based Federated Deep Reinforcement Learning for Trusted Autonomous Driving

被引:18
|
作者
Rjoub, Gaith [1 ]
Bentahar, Jamal [1 ]
Wahab, Omar Abdel [2 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn CIISE, Montreal, PQ, Canada
[2] Univ Quebec Outaouais, Dept Comp Sci & Engn, Gatineau, PQ, Canada
关键词
Trajectory Planning; Autonomous Vehicles Selection; Deep Reinforcement Learning; Federated Learning; Edge Computing; Trust; Explainable Artificial Intelligence;
D O I
10.1109/IWCMC55113.2022.9824617
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, the concept of autonomous driving became prevalent in the domain of intelligent transportation due to the promises of increased safety, traffic efficiency, fuel economy and reduced travel time. Numerous studies have been conducted in this area to help newcomer vehicles plan their trajectory and velocity. However, most of these proposals only consider trajectory planning using conjunction with a limited data set (i.e., metropolis areas, highways, and residential areas) or assume fully connected and automated vehicle environment. Moreover, these approaches are not explainable and lack trust regarding the contributions of the participating vehicles. To tackle these problems, we design an Explainable Artificial Intelligence (XAI) Federated Deep Reinforcement Learning model to improve the effectiveness and trustworthiness of the trajectory decisions for newcomer Autonomous Vehicles (AVs). When a newcomer AV seeks help for trajectory planning, the edge server launches a federated learning process to train the trajectory and velocity prediction model in a distributed collaborative fashion among participating AVs. One essential challenge in this approach is AVs selection, i.e., how to select the appropriate AVs that should participate in the federated learning process. For this purpose, XAI is first used to compute the contribution of each feature contributed by each vehicle to the overall solution. This helps us compute the trust value for each AV in the model. Then, a trust-based deep reinforcement learning model is put forward to make the selection decisions. Experiments using a real-life dataset show that our solution achieves better performance than benchmark solutions (i.e., Deep Q-Network (DQN), and Random Selection (RS)).
引用
收藏
页码:318 / 323
页数:6
相关论文
共 50 条
  • [41] Autonomous driving policy learning based on deep reinforcement learning and multi-type sensor data
    Yang S.
    Jiang Y.-D.
    Wu J.
    Liu H.-Z.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2019, 49 (04): : 1026 - 1033
  • [42] Federated Deep Reinforcement Learning for Task Scheduling in Heterogeneous Autonomous Robotic System
    Ho, Tai Manh
    Nguyen, Kim-Khoa
    Cheriet, Mohamed
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (01) : 528 - 540
  • [43] Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review
    Kuznietsov, Anton
    Gyevnar, Balint
    Wang, Cheng
    Peters, Steven
    Albrecht, Stefano V.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [44] Federated Deep Reinforcement Learning for Task Scheduling in Heterogeneous Autonomous Robotic System
    Tai Manh Ho
    Kim-Khoa Nguyen
    Cheriet, Mohamed
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1134 - 1139
  • [45] AI-Based Resource Provisioning of IoE Services in 6G: A Deep Reinforcement Learning Approach
    Sami, Hani
    Otrok, Hadi
    Bentahar, Jamal
    Mourad, Azzam
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (03): : 3527 - 3540
  • [46] Explainable AI and Robustness-Based Test and Evaluation of Reinforcement Learning
    Raz, Ali K.
    Mall, Kshitij
    Nolan, Sean Matthew
    Levin, Winston
    Mockus, Linas
    Ezra, Kris
    Mia, Ahmad
    Williams, Kyle
    Parish, Julie
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (05) : 6110 - 6123
  • [47] Development of AI-based process controller of sour water treatment unit using deep reinforcement learning
    Wang, Hai
    Guo, Yeshuang
    Li, Long
    Li, Shaojun
    JOURNAL OF THE TAIWAN INSTITUTE OF CHEMICAL ENGINEERS, 2024, 157
  • [48] Efficient Deep Reinforcement Learning With Imitative Expert Priors for Autonomous Driving
    Huang, Zhiyu
    Wu, Jingda
    Lv, Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7391 - 7403
  • [49] Model-free Deep Reinforcement Learning for Urban Autonomous Driving
    Chen, Jianyu
    Yuan, Bodi
    Tomizuka, Masayoshi
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 2765 - 2771
  • [50] Complex Network Cognition-Based Federated Reinforcement Learning for End-to-End Urban Autonomous Driving
    Cai, Yingfeng
    Lu, Sikai
    Wang, Hai
    Lian, Yubo
    Chen, Long
    Liu, Qingchao
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (03): : 7513 - 7525