Sora for Intelligent Vehicles: A Step From Constraint-Based Simulation to Artificiofactual Experiments Through Dynamic Visualization

被引:1
作者
Wang, Xumeng [1 ]
Xue, Xiao [2 ]
Yan, Ran [3 ]
Wang, Xingxia [4 ,5 ]
Di, Yining [6 ]
Chen, Wei [7 ]
Wang, Fei-Yue [4 ,5 ]
机构
[1] Nankai Univ, Coll Cyber Sci, Tianjin 300381, Peoples R China
[2] Tianjin Univ, Coll Intelligence & Comp, Sch Comp Software, Tianjin 300072, Peoples R China
[3] Nanyang Technol Univ, Sch Civil & Environm Engn, Singapore 639798, Singapore
[4] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[5] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[6] Hong Kong Univ Sci & Technol, Dept Civil & Environm Engn, Hong Kong, Peoples R China
[7] Zhejiang Univ, State Key Lab CAD&CG, Zhejiang 310058, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2024年 / 9卷 / 03期
基金
中国国家自然科学基金;
关键词
Intelligent vehicles; artificiofactual experiments; Sora; dynamic visualization; ARTIFICIAL-INTELLIGENCE; TRANSPORTATION SYSTEMS; TRENDS;
D O I
10.1109/TIV.2024.3384550
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Scenario simulation plays an integral role in the development, application, and management of intelligent vehicles. However, planning agents and customizing scenarios for complex systems are laborious, making it challenging to implement high-performance simulations. The striking progress made by Sora, a large-scale text-to-video model, suggests a research opportunity for high-performance simulation through dynamic visualizations. This paper reports the prospective effects of Sora on the scenario simulation of intelligent vehicles. Specifically, we review the achievements of Sora, picture the perspectives of artificiofactual experiments on intelligent vehicles based on the performance of Sora-type techniques, and discuss how far are we now.
引用
收藏
页码:4249 / 4253
页数:5
相关论文
共 48 条
[1]   PMWorld: A Parallel Testing Platform for Autonomous Driving in Mines [J].
Ai, Yunfeng ;
Liu, Yuhang ;
Gao, Yu ;
Zhao, Chen ;
Cheng, Xiang ;
Han, Jinpeng ;
Tian, Bin ;
Chen, Long ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01) :1402-1411
[2]   Clustrophile 2: Guided Visual Clustering Analysis [J].
Cavallo, Marco ;
Demiralp, Cagatay .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2019, 25 (01) :267-276
[3]   Deep Neural Network Based Vehicle and Pedestrian Detection for Autonomous Driving: A Survey [J].
Chen, Long ;
Lin, Shaobo ;
Lu, Xiankai ;
Cao, Dongpu ;
Wu, Hangbin ;
Guo, Chi ;
Liu, Chun ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (06) :3234-3246
[4]   A Survey of Traffic Data Visualization [J].
Chen, Wei ;
Guo, Fangzhou ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, 16 (06) :2970-2984
[5]   Identifying the skeptics and the undecided through visual cluster analysis of local network geometry [J].
Cheng, Shenghui ;
Giesen, Joachim ;
Huang, Tianyi ;
Lucas, Philipp ;
Mueller, Klaus .
VISUAL INFORMATICS, 2022, 6 (03) :11-22
[6]   Image-based traffic signal control via world models [J].
Dai, Xingyuan ;
Zhao, Chen ;
Wang, Xiao ;
Lv, Yisheng ;
Lin, Yilun ;
Wang, Fei-Yue .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2022, 23 (12) :1795-1813
[7]   Chat With ChatGPT on Intelligent Vehicles: An IEEE TIV Perspective [J].
Du, Haiping ;
Teng, Siyu ;
Chen, Hong ;
Ma, Jiaqi ;
Wang, Xiao ;
Gou, Chao ;
Li, Bai ;
Ma, Siji ;
Miao, Qinghai ;
Na, Xiaoxiang ;
Ye, Peijun ;
Zhang, Hui ;
Luo, Guiyang ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (03) :2020-2026
[8]   Sora for foundation robots with parallel intelligence: three world models, three robotic systems [J].
Fan, Lili ;
Guo, Chao ;
Tian, Yonglin ;
Zhang, Hui ;
Zhang, Jun ;
Wang, Fei-Yue .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2024, 25 (07) :917-923
[9]   Chat With ChatGPT on Interactive Engines for Intelligent Driving [J].
Gao, Yubing ;
Tong, Wei ;
Wu, Edmond Q. Q. ;
Chen, Wei ;
Zhu, GuangYu ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (03) :2034-2036
[10]   IVMS: An immersive virtual meteorological sandbox based on WYSIWYG [J].
Hu, Hao ;
Wang, Song ;
Chen, Yonghui .
VISUAL INFORMATICS, 2023, 7 (04) :100-109