LLMScenario: Large Language Model Driven Scenario Generation

被引:13
作者
Chang, Cheng [1 ]
Wang, Siqi [1 ]
Zhang, Jiawei [1 ]
Ge, Jingwei [1 ]
Li, Li [2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Automat, BNRist, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2024年 / 54卷 / 11期
关键词
Scenario generation; Cognition; Autonomous vehicles; Tuning; Testing; Semantics; Task analysis; Large language model (LLM); scenario engineering; scenario generation;
D O I
10.1109/TSMC.2024.3392930
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Scenario engineering plays a vital role in various Industry 5.0 applications. In the field of autonomous driving systems, driving scenario data are important for the training and testing of critical modules. However, the corner scenario cases are usually rare and necessary to be extended. Existing methods cannot handle the interpretation and reasoning of the generation process well, which reduces the reliability and usability of the generated scenarios. With the rapid development of Foundation Models, especially the large language model (LLM), we can conduct scenario generation via more powerful tools. In this article, we propose LLMScenario, a novel LLM-driven scenario generation framework, which is composed of scenario prompt engineering, LLM scenario generation, and evaluation feedback tuning. The minimum scenario description specific to LLM is given by scenario analysis and ablation studies. We also appropriately design the score functions in terms of reality and rarity to evaluate the generated scenarios. The model performance is further enhanced through chain-of-thoughts and experiences. Different LLMs are also compared with our framework. Experimental results on naturalistic datasets demonstrate the effectiveness of LLMScenario, which can provide solid support for scenario engineering in Industry 5.0.
引用
收藏
页码:6581 / 6594
页数:14
相关论文
共 92 条
[81]   A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development [J].
Wu, Tianyu ;
He, Shizhu ;
Liu, Jingping ;
Sun, Siqi ;
Liu, Kang ;
Han, Qing-Long ;
Tang, Yang .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (05) :1122-1136
[82]   A Parallel Tempering Approach for Efficient Exploration of the Verification Tradespace in Engineered Systems [J].
Xu, Peng ;
Salado, Alejandro ;
Deng, Xinwei .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (11) :7223-7235
[83]  
Xu ZH, 2024, Arxiv, DOI arXiv:2310.01412
[84]   Parallel Emergency Management of Incidents by Integrating OODA and PREA Loops: The C2 Mechanism and Modes [J].
Yang, Dongsheng ;
Li, Qiang ;
Zhu, Fenghua ;
Cui, Huachao ;
Yi, Wen ;
Qin, Jirong .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (04) :2160-2172
[85]   DeFACT in ManuVerse for Parallel Manufacturing: Foundation Models and Parallel Workers in Smart Factories [J].
Yang, Jing ;
Li, Shimeng ;
Wang, Xiaoxing ;
Lu, Jingwei ;
Wu, Huaiyu ;
Wang, Xiao .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (04) :2188-2199
[86]   How to Guarantee Driving Safety for Autonomous Vehicles in a Real-World Environment: A Perspective on Self-Evolution Mechanisms [J].
Yang, Shuo ;
Huang, Yanjun ;
Li, Li ;
Feng, Shuo ;
Na, Xiaoxiang ;
Chen, Hong ;
Khajepour, Amir .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2024, 16 (02) :41-54
[87]   Parallel Vision for Intelligent Transportation Systems in Metaverse: Challenges, Solutions, and Potential Applications [J].
Zhang, Hui ;
Luo, Guiyang ;
Li, Yidong ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (06) :3400-3413
[88]   A Systematic Solution of Human Driving Behavior Modeling and Simulation for Automated Vehicle Studies [J].
Zhang, Kunpeng ;
Chang, Cheng ;
Zhong, Wenqin ;
Li, Shen ;
Li, Zhiheng ;
Li, Li .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :21944-21958
[89]   Finding Critical Scenarios for Automated Driving Systems: A Systematic Mapping Study [J].
Zhang, Xinhai ;
Tao, Jianbo ;
Tan, Kaige ;
Torngren, Martin ;
Sanchez, Jose Manuel Gaspar ;
Ramli, Muhammad Rusyadi ;
Tao, Xin ;
Gyllenhammar, Magnus ;
Wotawa, Franz ;
Mohan, Naveen ;
Nica, Mihai ;
Felbinger, Hermann .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2023, 49 (03) :991-1026
[90]   Decentralized Autonomous Operations and Organizations in TransVerse: Federated Intelligence for Smart Mobility [J].
Zhao, Chen ;
Dai, Xingyuan ;
Lv, Yisheng ;
Niu, Jinglong ;
Lin, Yilun .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (04) :2062-2072