Evaluation of MPC-based Imitation Learning for Human-like Autonomous Driving

被引:1
|
作者
Acerbo, Flavia Sofia [1 ,2 ,3 ]
Swevers, Jan [2 ,4 ]
Tuytelaars, Tinne [3 ]
Son, Tong Duy [1 ]
机构
[1] Siemens Digital Ind Software, Leuven, Belgium
[2] Katholieke Univ Leuven, Dept Mech Engn, MECO Res Team, Leuven, Belgium
[3] Katholieke Univ Leuven, Dept Elect Engn, PSI Res Team, Leuven, Belgium
[4] Flanders Make KU Leuven, Leuven, Belgium
来源
IFAC PAPERSONLINE | 2023年 / 56卷 / 02期
关键词
Autonomous Vehicles; Learning and adaptation in autonomous vehicles; Human and vehicle interaction;
D O I
10.1016/j.ifacol.2023.10.1257
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work evaluates and analyzes the combination of imitation learning (IL) and differentiable model predictive control (MPC) for the application of human-like autonomous driving. We combine MPC with a hierarchical learning-based policy, and measure its performance in open-loop and closed-loop with metrics related to safety, comfort and similarity to human driving characteristics. We also demonstrate the value of augmenting open-loop behavioral cloning with closed-loop training for a more robust learning, approximating the policy gradient through time with the state space model used by the MPC. We perform experimental evaluations on a lane keeping control system, learned from demonstrations collected on a fixed-base driving simulator, and show that our imitative policies approach the human driving style preferences. Copyright (c) 2023 The Authors. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
引用
收藏
页码:4871 / 4876
页数:6
相关论文
共 50 条
  • [1] Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving
    Acerbo, Flavia Sofia
    Alirczaei, Mohsen
    Van der Auweraer, Herman
    Tong Duy Son
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 3903 - 3908
  • [2] Learning From Naturalistic Driving Data for Human-Like Autonomous Highway Driving
    Xu, Donghao
    Ding, Zhezhang
    He, Xu
    Zhao, Huijing
    Moze, Mathieu
    Aioun, Francois
    Guillemard, Franck
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (12) : 7341 - 7354
  • [3] Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning
    Zong, Ziqi
    Shi, Jiamin
    Wang, Runsheng
    Chen, Shitao
    Zheng, Nanning
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 3922 - 3929
  • [4] A Human-Like Agent Based on a Hybrid of Reinforcement and Imitation Learning
    Dossa, Rousslan Fernand Julien
    Lian, Xinyu
    Nomoto, Hirokazu
    Matsubara, Takashi
    Uehara, Kuniaki
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [5] MPC-based Path Tracking Control with Forward Compensation for Autonomous Driving
    Nan, Jiangfeng
    Shang, Bingxu
    Deng, Weiwen
    Ren, Bingtao
    Liu, Yang
    IFAC PAPERSONLINE, 2021, 54 (10): : 443 - 448
  • [6] An open framework for human-like autonomous driving using Inverse Reinforcement Learning
    Vasquez, Dizan
    Yu, Yufeng
    Kumar, Suryansh
    Laugier, Christian
    2014 IEEE VEHICLE POWER AND PROPULSION CONFERENCE (VPPC), 2014,
  • [7] Training human-like bots with Imitation Learning based on provenance data
    Ramos Cavadas, Lauro Victor
    Clua, Esteban
    Kohwalter, Troy Costa
    Melo, Sidney Araujo
    2022 21ST BRAZILIAN SYMPOSIUM ON COMPUTER GAMES AND DIGITAL ENTERTAINMENT (SBGAMES), 2022, : 55 - 60
  • [8] SOCIAL FORCE CONTROL FOR HUMAN-LIKE AUTONOMOUS DRIVING
    Yoon, DoHyun Daniel
    Ayalew, Beshah
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2018, VOL 3, 2018,
  • [9] A novel behavior planning for human-like autonomous driving
    Cai, Lei
    Guan, Hsin
    Xu, Qi Hong
    Jia, Xin
    Zhan, Jun
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2025,
  • [10] Human-like driving technology for autonomous electric vehicles
    Hongliang Lu
    Meixin Zhu
    Hai Yang
    Nature Reviews Electrical Engineering, 2025, 2 (4): : 218 - 219