More Persuasive Explanation Method for End-to-End Driving Models

被引:2
作者
Zhang, Chenkai [1 ]
Deguchi, Daisuke [1 ]
Okafuji, Yuki [2 ]
Murase, Hiroshi [1 ]
机构
[1] Nagoya Univ, Grad Sch Informat, Nagoya 4648601, Japan
[2] CyberAgent Inc, AI Lab, Tokyo 1506121, Japan
基金
日本科学技术振兴机构; 日本学术振兴会;
关键词
Task analysis; Predictive models; Pipelines; Autonomous vehicles; Computational modeling; Autonomous driving; Convolutional neural networks; convolutional neural network; end-to-end model; explainability;
D O I
10.1109/ACCESS.2023.3235739
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of autonomous driving technology, a variety of high-performance end-to-end driving models (E2EDMs) are being proposed. In order to understand the computational methods of E2EDMs, pixel-level explanations methods are used to obtain the explanations of the E2EDMs. However, little attention has been paid to the excellence of the explanations of E2EDMs. Therefore, in order to build trustworthy E2EDMs, we focus on improving the persuasibility of the explanations of E2EDMs. We propose an object-level explanation method (main approach) for E2EDMs, which masks the objects in the image and then treats the change in the prediction result as the importance of the objects, then we explain the E2EDM by the importance of each object. To further validate the effectiveness of object-level explanations, we propose another approach (validation approach), which trains E2EDMs with object information as input and generates the importance of objects using general explanation methods. Both approaches generate object-level explanations, in order to compare these object-level explanations with traditional pixel-level explanations, we propose experimental methods to measure the persuasibility of explanations of E2EDMs through a subjective and objective method. The subjective method evaluates persuasibility based on the extent to which participants think the importance of features indicated by the explanations is correct. The objective method evaluates the persuasibility based on the human annotation similarity between provided with only the important part of images and provided with the complete images. The experimental results show that the object-level explanations are more persuasive than the traditional pixel-level explanations.
引用
收藏
页码:4270 / 4282
页数:13
相关论文
共 50 条
[41]   Study and Generalization on an End-to-End Spatial-temporal Driving Model [J].
Yao, Tingting ;
Chen, Xin ;
Yuan, Sheng ;
Wang, Huaying ;
Guo, Lili ;
Tian, Bin ;
Ai, Yunfeng .
2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, :4755-4760
[42]   End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning [J].
Huang, Zhiqing ;
Zhang, Ji ;
Tian, Rui ;
Zhang, Yanxin .
CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, :658-662
[43]   End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning [J].
Huang Z.-Q. ;
Qu Z.-W. ;
Zhang J. ;
Zhang Y.-X. ;
Tian R. .
Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09) :1711-1719
[44]   An End-to-End Motion Planner Using Sensor Fusion for Autonomous Driving [J].
Thu, Nguyen Thi Hoai ;
Han, Dong Seog .
2023 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION, ICAIIC, 2023, :678-683
[45]   Multi-modal policy fusion for end-to-end autonomous driving [J].
Huang, Zhenbo ;
Sun, Shiliang ;
Zhao, Jing ;
Mao, Liang .
INFORMATION FUSION, 2023, 98
[46]   Performance optimization of autonomous driving control under end-to-end deadlines [J].
Yunhao Bai ;
Li Li ;
Zejiang Wang ;
Xiaorui Wang ;
Junmin Wang .
Real-Time Systems, 2022, 58 :509-547
[47]   An End-to-End Deep Learning System for Hop Classification [J].
Castro, Pedro ;
Moreira, Gladston ;
Luz, Eduardo .
IEEE LATIN AMERICA TRANSACTIONS, 2022, 20 (03) :430-442
[48]   DriveGPT4: Interpretable End-to-End Autonomous Driving Via Large Language Model [J].
Xu, Zhenhua ;
Zhang, Yujia ;
Xie, Enze ;
Zhao, Zhen ;
Guo, Yong ;
Wong, Kwan-Yee K. ;
Li, Zhenguo ;
Zhao, Hengshuang .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (10) :8186-8193
[49]   HybridTE2: Hybrid Transformer-based End-to-End Learning for Autonomous Driving [J].
Rayakota, Haritha Prasad ;
Huang, Pei-Chi .
2024 IEEE 7TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS 2024, 2024,
[50]   Drive in Corridors: Enhancing the Safety of End-to-End Autonomous Driving via Corridor Learning and Planning [J].
Zhang, Zhiwei ;
Yang, Ruichen ;
Wu, Ke ;
Xu, Zijun ;
Liu, Jingchu ;
Mu, Lisen ;
Gan, Zhongxue ;
Ding, Wenchao .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (07) :6728-6735