DrPlanner: Diagnosis and Repair of Motion Planners for Automated Vehicles Using Large Language Models

被引:0
作者
Lin, Yuanfei [1 ]
Li, Chenran [2 ]
Ding, Mingyu [2 ]
Tomizuka, Masayoshi [2 ]
Zhan, Wei [2 ]
Althoff, Matthias [1 ]
机构
[1] Tech Univ Munich, Sch Computat Informat & Technol, D-85748 Garching, Germany
[2] Univ Calif Berkeley, Dept Mech Engn, Berkeley, CA 94720 USA
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 10期
关键词
Automated software repair; integrated planning and learning; intelligent transportation systems; large language models; motion and path planning;
D O I
10.1109/LRA.2024.3441493
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Motion planners are essential for the safe operation of automated vehicles across various scenarios. However, no motion planning algorithm has achieved perfection in the literature, and improving its performance is often time-consuming and labor-intensive. To tackle the aforementioned issues, we present ${\mathtt {DrPlanner}}$, the first framework designed to automatically diagnose and repair motion planners using large language models. Initially, we generate a structured description of the planner and its planned trajectories from both natural and programming languages. Leveraging the profound capabilities of large language models, our framework returns repaired planners with detailed diagnostic descriptions. Furthermore, our framework advances iteratively with continuous feedback from the evaluation of the repaired outcomes. Our approach is validated using both search- and sampling-based motion planners for automated vehicles; experimental results highlight the need for demonstrations in the prompt and show the ability of our framework to effectively identify and rectify elusive issues.
引用
收藏
页码:8218 / 8225
页数:8
相关论文
共 54 条
  • [1] 2023, Arxiv, DOI [arXiv:2303.08774, DOI 10.48550/ARXIV.2303.08774]
  • [2] Althoff M, 2017, IEEE INT VEH SYM, P719, DOI 10.1109/IVS.2017.7995802
  • [3] Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles
    Aradi, Szilard
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) : 740 - 759
  • [4] Austin J., 2021, arXiv
  • [5] Bahdanau K., 2015, INT C LEARN REPR
  • [6] Brown TB, 2020, ADV NEUR IN, V33
  • [7] Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving
    Chen, Long
    Sinavski, Oleg
    Hunermann, Jan
    Karnsund, Alice
    Willmott, Andrew James
    Birch, Danny
    Maund, Daniel
    Shotton, Jamie
    [J]. 2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 14093 - 14100
  • [8] Chen M., 2021, arXiv, DOI [10.48550/arXiv.2107.03374, DOI 10.48550/ARXIV.2107.03374]
  • [9] Chen X., 2023, P INT C LEARN REPR
  • [10] Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles
    Cui, Can
    Ma, Yunsheng
    Cao, Xu
    Ye, Wenqian
    Wang, Ziran
    [J]. 2024 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS, WACVW 2024, 2024, : 902 - 909