LLMScenario: Large Language Model Driven Scenario Generation

被引:13
作者
Chang, Cheng [1 ]
Wang, Siqi [1 ]
Zhang, Jiawei [1 ]
Ge, Jingwei [1 ]
Li, Li [2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Automat, BNRist, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2024年 / 54卷 / 11期
关键词
Scenario generation; Cognition; Autonomous vehicles; Tuning; Testing; Semantics; Task analysis; Large language model (LLM); scenario engineering; scenario generation;
D O I
10.1109/TSMC.2024.3392930
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Scenario engineering plays a vital role in various Industry 5.0 applications. In the field of autonomous driving systems, driving scenario data are important for the training and testing of critical modules. However, the corner scenario cases are usually rare and necessary to be extended. Existing methods cannot handle the interpretation and reasoning of the generation process well, which reduces the reliability and usability of the generated scenarios. With the rapid development of Foundation Models, especially the large language model (LLM), we can conduct scenario generation via more powerful tools. In this article, we propose LLMScenario, a novel LLM-driven scenario generation framework, which is composed of scenario prompt engineering, LLM scenario generation, and evaluation feedback tuning. The minimum scenario description specific to LLM is given by scenario analysis and ablation studies. We also appropriately design the score functions in terms of reality and rarity to evaluate the generated scenarios. The model performance is further enhanced through chain-of-thoughts and experiences. Different LLMs are also compared with our framework. Experimental results on naturalistic datasets demonstrate the effectiveness of LLMScenario, which can provide solid support for scenario engineering in Industry 5.0.
引用
收藏
页码:6581 / 6594
页数:14
相关论文
共 92 条
[1]  
Abeysirigoonawardena Y, 2019, IEEE INT CONF ROBOT, P8271, DOI [10.1109/ICRA.2019.8793740, 10.1109/icra.2019.8793740]
[2]  
Althoff M, 2018, IEEE INT VEH SYM, P1326, DOI 10.1109/IVS.2018.8500374
[3]  
Althoff M, 2017, IEEE INT VEH SYM, P719, DOI 10.1109/IVS.2017.7995802
[4]  
[Anonymous], 2021, Asam Openscenario
[5]  
[Anonymous], 2023, Gpt-4 technical report
[6]  
Bagschik G, 2018, IEEE INT VEH SYM, P1813, DOI 10.1109/IVS.2018.8500632
[7]  
Brown TB, 2020, ADV NEUR IN, V33
[8]   Data visualization with multidimensional scaling [J].
Buja, Andreas ;
Swayne, Deborah F. ;
Littman, Michael L. ;
Dean, Nathaniel ;
Hofmann, Heike ;
Chen, Lisha .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2008, 17 (02) :444-472
[9]  
Chang C, 2024, Arxiv, DOI arXiv:2402.07720
[10]   BEV-V2X: Cooperative Birds-Eye-View Fusion and Grid Occupancy Prediction via V2X-Based Data Sharing [J].
Chang, Cheng ;
Zhang, Jiawei ;
Zhang, Kunpeng ;
Zhong, Wenqin ;
Peng, Xinyu ;
Li, Shen ;
Li, Li .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (11) :4498-4514