MetaScenario: A Framework for Driving Scenario Data Description, Storage and Indexing

被引:28
作者
Chang, Cheng [1 ]
Cao, Dongpu [2 ]
Chen, Long [3 ]
Su, Kui [4 ]
Su, Kuifeng
Su, Yuelong [5 ]
Wang, Fei-Yue [6 ,7 ]
Wang, Jue
Wang, Ping [8 ]
Wei, Junqing [9 ]
Wu, Gansha [10 ]
Wu, Xiangbin [11 ]
Xu, Huile [12 ]
Zheng, Nanning [13 ]
Li, Li [14 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Univ Waterloo, Dept Mech & Mechatron Engn, Waterloo, ON N2L 3G1, Canada
[3] Waytous Inc, Beijing 100083, Peoples R China
[4] Alibaba DAMO Acad Autonomous Driving Lab, Hangzhou 311121, Peoples R China
[5] AutoNavi Software Co, Traff Management Solut Div, Beijing 100102, Peoples R China
[6] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[7] Qingdao Acad Intelligent Ind, Qingdao 266000, Peoples R China
[8] Peking Univ, Beijing 100084, Peoples R China
[9] DiDi Autonomous Driving Co, Beijing 100094, Peoples R China
[10] Uisee Technol Beijing Co Ltd, Beijing 100028, Peoples R China
[11] Intel Labs China, Beijing 100190, Peoples R China
[12] Chinese Acad Sci, Inst Automat, Momenta & Natl Lab Pattern Recognit, Beijing 100084, Peoples R China
[13] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot IAIR, Xian 710049, Peoples R China
[14] Tsinghua Univ, Dept Automat, BNRist, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2023年 / 8卷 / 02期
关键词
Cameras; Laser radar; Autonomous vehicles; Roads; Annotations; Trajectory; Indexing; Driving scenario; data storage; data indexing; CLASSIFICATION; INTELLIGENCE; STRATEGY; VEHICLES;
D O I
10.1109/TIV.2022.3215503
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autonomous driving related researches require the analysis and usage of massive amounts of driving scenario data. Compared to raw data collected by sensors, scenario data provide a preliminary abstraction of driving tasks and processes, explicitly integrate information about the road environment and the dynamic and static attributes of traffic participants, making it easier to conduct task understanding and decision making. However, many existing driving scenario datasets have the following two problems. First, it is not clear which data fields need to be recorded for driving scenarios. The data storage formats and organization standards are inconsistent. Second, the datasets cannot establish driving scenario indexing effectively. Existing datasets are sparsely annotated and difficult to index, which is detrimental to data sampling and extraction for machine learning process, thus hindering efficient fusion and reuse. In this paper, we propose MetaScenario, a framework for driving scenario data. We describe driving scenarios and design the centralized and unified data framework for the storage, processing, and indexing of scenario data based on relational database. The concept of atom scenario is proposed and characterized using semantic graphs. We also annotate and classify behaviors and interactions of traffic participants in atom scenarios by extracting the spatiotemporal evolution of semantic information. The annotation facilitates the indexing and extraction of data. The scenario datasets are further evaluated via the data distribution and annotation statistics. MetaScenario can provide researchers with convenient tools for scenario data extraction and important analytical references.
引用
收藏
页码:1156 / 1175
页数:20
相关论文
共 86 条
  • [1] A cooperative heterogeneous vehicular clustering framework for efficiency improvement
    Ahmad, Iftikhar
    Noor, Rafidah Md
    Ahmed, Zaheed
    Umm-e-Habiba
    Akram, Naveed
    Garcia Marquez, Fausto Pedro
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (09) : 1247 - 1259
  • [2] Categorizing Object-Action Relations from Semantic Scene Graphs
    Aksoy, Eren Erdal
    Abramov, Alexey
    Woergoetter, Florentin
    Dellen, Babette
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 398 - 405
  • [3] Althoff M, 2017, IEEE INT VEH SYM, P719, DOI 10.1109/IVS.2017.7995802
  • [4] [Anonymous], 2019, RES THEORETICAL SYST
  • [5] [Anonymous], 2019, INTRO OVERVIEW 35 YE
  • [6] Armand A, 2014, IEEE INT VEH SYM, P227, DOI 10.1109/IVS.2014.6856509
  • [7] Asam opencrg, 2020, US
  • [8] Asam openscenario, 2021, US
  • [9] Bagschik G, 2018, IEEE INT VEH SYM, P1813, DOI 10.1109/IVS.2018.8500632
  • [10] Connectivity-Based Delay-Tolerant Control of Automated Vehicles: Theory and Experiments
    Beregi, Sandor
    Avedisov, Sergei S.
    He, Chaozhe R.
    Takacs, Denes
    Orosz, Gabor
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 275 - 289