MetaScenario: A Framework for Driving Scenario Data Description, Storage and Indexing

被引:28
作者
Chang, Cheng [1 ]
Cao, Dongpu [2 ]
Chen, Long [3 ]
Su, Kui [4 ]
Su, Kuifeng
Su, Yuelong [5 ]
Wang, Fei-Yue [6 ,7 ]
Wang, Jue
Wang, Ping [8 ]
Wei, Junqing [9 ]
Wu, Gansha [10 ]
Wu, Xiangbin [11 ]
Xu, Huile [12 ]
Zheng, Nanning [13 ]
Li, Li [14 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Univ Waterloo, Dept Mech & Mechatron Engn, Waterloo, ON N2L 3G1, Canada
[3] Waytous Inc, Beijing 100083, Peoples R China
[4] Alibaba DAMO Acad Autonomous Driving Lab, Hangzhou 311121, Peoples R China
[5] AutoNavi Software Co, Traff Management Solut Div, Beijing 100102, Peoples R China
[6] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[7] Qingdao Acad Intelligent Ind, Qingdao 266000, Peoples R China
[8] Peking Univ, Beijing 100084, Peoples R China
[9] DiDi Autonomous Driving Co, Beijing 100094, Peoples R China
[10] Uisee Technol Beijing Co Ltd, Beijing 100028, Peoples R China
[11] Intel Labs China, Beijing 100190, Peoples R China
[12] Chinese Acad Sci, Inst Automat, Momenta & Natl Lab Pattern Recognit, Beijing 100084, Peoples R China
[13] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot IAIR, Xian 710049, Peoples R China
[14] Tsinghua Univ, Dept Automat, BNRist, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2023年 / 8卷 / 02期
关键词
Cameras; Laser radar; Autonomous vehicles; Roads; Annotations; Trajectory; Indexing; Driving scenario; data storage; data indexing; CLASSIFICATION; INTELLIGENCE; STRATEGY; VEHICLES;
D O I
10.1109/TIV.2022.3215503
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autonomous driving related researches require the analysis and usage of massive amounts of driving scenario data. Compared to raw data collected by sensors, scenario data provide a preliminary abstraction of driving tasks and processes, explicitly integrate information about the road environment and the dynamic and static attributes of traffic participants, making it easier to conduct task understanding and decision making. However, many existing driving scenario datasets have the following two problems. First, it is not clear which data fields need to be recorded for driving scenarios. The data storage formats and organization standards are inconsistent. Second, the datasets cannot establish driving scenario indexing effectively. Existing datasets are sparsely annotated and difficult to index, which is detrimental to data sampling and extraction for machine learning process, thus hindering efficient fusion and reuse. In this paper, we propose MetaScenario, a framework for driving scenario data. We describe driving scenarios and design the centralized and unified data framework for the storage, processing, and indexing of scenario data based on relational database. The concept of atom scenario is proposed and characterized using semantic graphs. We also annotate and classify behaviors and interactions of traffic participants in atom scenarios by extracting the spatiotemporal evolution of semantic information. The annotation facilitates the indexing and extraction of data. The scenario datasets are further evaluated via the data distribution and annotation statistics. MetaScenario can provide researchers with convenient tools for scenario data extraction and important analytical references.
引用
收藏
页码:1156 / 1175
页数:20
相关论文
共 86 条
  • [61] Sowa JohnF., 1987, ENCY ARTIFICIAL INTE
  • [62] Scalability in Perception for Autonomous Driving: Waymo Open Dataset
    Sun, Pei
    Kretzschmar, Henrik
    Dotiwalla, Xerxes
    Chouard, Aurelien
    Patnaik, Vijaysai
    Tsui, Paul
    Guo, James
    Zhou, Yin
    Chai, Yuning
    Caine, Benjamin
    Vasudevan, Vijay
    Han, Wei
    Ngiam, Jiquan
    Zhao, Hang
    Timofeev, Aleksei
    Ettinger, Scott
    Krivokon, Maxim
    Gao, Amy
    Joshi, Aditya
    Zhang, Yu
    Shlens, Jonathon
    Chen, Zhifeng
    Anguelov, Dragomir
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2443 - 2451
  • [63] ATOP: An Attention-to-Optimization Approach for Automatic LiDAR-Camera Calibration via Cross-Modal Object Matching
    Sun, Yi
    Li, Jian
    Wang, Yuru
    Xu, Xin
    Yang, Xiaohui
    Sun, Zhenping
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 696 - 708
  • [64] U.S. Department of Transportation, 2007, NGSIM NEXT GEN SIM
  • [65] Defining and Substantiating the Terms Scene, Situation, and Scenario for Automated Driving
    Ulbrich, Simon
    Menzel, Till
    Reschka, Andreas
    Schuldt, Fabian
    Maurer, Markus
    [J]. 2015 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, : 982 - 988
  • [66] Cooperative Driving of Automated Vehicles Using B-Splines for Trajectory Planning
    Van Hoek, Robbin
    Ploeg, Jeroen
    Nijmeijer, Henk
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (03): : 594 - 604
  • [67] Wang F. -Y., 2003, AUTOPENPROJECT PROPO
  • [68] China's 12-Year Quest of Autonomous Vehicular Intelligence: The Intelligent Vehicles Future Challenge Program
    Wang, Fei-Yue
    Zheng, Nan-Ning
    Li, Li
    Xin, Jingmin
    Wang, Xiao
    Xu, Linhai
    Tian, Bin
    Wu, Guozheng
    Zhang, Zhaotian
    Wang, Chenghong
    Chen, Long
    [J]. IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2021, 13 (02) : 6 - 19
  • [69] Wang FS, 2021, INFECT DIS IMMUN, V1, P1, DOI 10.1097/ID9.0000000000000004
  • [70] Speed and Accuracy Tradeoff for LiDAR Data Based Road Boundary Detection
    Wang, Guojun
    Wu, Jian
    He, Rui
    Tian, Bin
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (06) : 1210 - 1220