LLMScenario: Large Language Model Driven Scenario Generation

被引:13
作者
Chang, Cheng [1 ]
Wang, Siqi [1 ]
Zhang, Jiawei [1 ]
Ge, Jingwei [1 ]
Li, Li [2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Automat, BNRist, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2024年 / 54卷 / 11期
关键词
Scenario generation; Cognition; Autonomous vehicles; Tuning; Testing; Semantics; Task analysis; Large language model (LLM); scenario engineering; scenario generation;
D O I
10.1109/TSMC.2024.3392930
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Scenario engineering plays a vital role in various Industry 5.0 applications. In the field of autonomous driving systems, driving scenario data are important for the training and testing of critical modules. However, the corner scenario cases are usually rare and necessary to be extended. Existing methods cannot handle the interpretation and reasoning of the generation process well, which reduces the reliability and usability of the generated scenarios. With the rapid development of Foundation Models, especially the large language model (LLM), we can conduct scenario generation via more powerful tools. In this article, we propose LLMScenario, a novel LLM-driven scenario generation framework, which is composed of scenario prompt engineering, LLM scenario generation, and evaluation feedback tuning. The minimum scenario description specific to LLM is given by scenario analysis and ablation studies. We also appropriately design the score functions in terms of reality and rarity to evaluate the generated scenarios. The model performance is further enhanced through chain-of-thoughts and experiences. Different LLMs are also compared with our framework. Experimental results on naturalistic datasets demonstrate the effectiveness of LLMScenario, which can provide solid support for scenario engineering in Industry 5.0.
引用
收藏
页码:6581 / 6594
页数:14
相关论文
共 92 条
[61]   VistaGPT: Generative Parallel Transformers for Vehicles With Intelligent Systems for Transport Automation [J].
Tian, Yonglin ;
Li, Xuan ;
Zhang, Hui ;
Zhao, Chen ;
Li, Bai ;
Wang, Xiao ;
Wang, Xiao ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (09) :4198-4207
[62]  
Touvron H, 2023, Arxiv, DOI [arXiv:2307.09288, 10.48550/arXiv.2307.09288]
[63]   The Intelligent Driver Model with Stochasticity-New Insights Into Traffic Flow Oscillations [J].
Treiber, Martin ;
Kesting, Arne .
PAPERS SELECTED FOR THE 22ND INTERNATIONAL SYMPOSIUM ON TRANSPORTATION AND TRAFFIC THEORY, 2017, 23 :174-187
[64]   Foundation Vehicles: From Foundation Intelligence to Foundation Transportation for Future Mobility [J].
Wang, Fei-Yue ;
Lv, Chen .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (10) :4287-4291
[65]   Testing Intelligence: Accelerating the Verification and Validation of Intelligent Vehicles [J].
Wang, Fei-Yue ;
Hu, Jia ;
Lai, Jintao .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (02) :1003-1016
[66]   Mutually trustworthy human-machine knowledge automation and hybrid augmented intelligence: mechanisms and applications of cognition, management, and control for complex systems [J].
Wang, Fei-Yue ;
Guo, Jianbo ;
Bu, Guangquan ;
Zhang, Jun Jason .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2022, 23 (08) :1142-1157
[67]   The Emergence of Intelligent Enterprises: From CPS to CPSS [J].
Wang, Fei-Yue .
IEEE INTELLIGENT SYSTEMS, 2010, 25 (04) :85-88
[68]  
Wang G, 2024, Arxiv, DOI arXiv:2309.11235
[69]   A Framework and Operational Procedures for Metaverses-Based Industrial Foundation Models [J].
Wang, Jiangong ;
Tian, Yonglin ;
Wang, Yutong ;
Yang, Jing ;
Wang, Xingxia ;
Wang, Sanjin ;
Kwan, Oliver .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (04) :2037-2046
[70]  
Wang LN, 2023, Arxiv, DOI [arXiv:2312.13156, DOI 10.48550/ARXIV.2312.13156]