MetaScenario: A Framework for Driving Scenario Data Description, Storage and Indexing

被引:28
作者
Chang, Cheng [1 ]
Cao, Dongpu [2 ]
Chen, Long [3 ]
Su, Kui [4 ]
Su, Kuifeng
Su, Yuelong [5 ]
Wang, Fei-Yue [6 ,7 ]
Wang, Jue
Wang, Ping [8 ]
Wei, Junqing [9 ]
Wu, Gansha [10 ]
Wu, Xiangbin [11 ]
Xu, Huile [12 ]
Zheng, Nanning [13 ]
Li, Li [14 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Univ Waterloo, Dept Mech & Mechatron Engn, Waterloo, ON N2L 3G1, Canada
[3] Waytous Inc, Beijing 100083, Peoples R China
[4] Alibaba DAMO Acad Autonomous Driving Lab, Hangzhou 311121, Peoples R China
[5] AutoNavi Software Co, Traff Management Solut Div, Beijing 100102, Peoples R China
[6] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[7] Qingdao Acad Intelligent Ind, Qingdao 266000, Peoples R China
[8] Peking Univ, Beijing 100084, Peoples R China
[9] DiDi Autonomous Driving Co, Beijing 100094, Peoples R China
[10] Uisee Technol Beijing Co Ltd, Beijing 100028, Peoples R China
[11] Intel Labs China, Beijing 100190, Peoples R China
[12] Chinese Acad Sci, Inst Automat, Momenta & Natl Lab Pattern Recognit, Beijing 100084, Peoples R China
[13] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot IAIR, Xian 710049, Peoples R China
[14] Tsinghua Univ, Dept Automat, BNRist, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2023年 / 8卷 / 02期
关键词
Cameras; Laser radar; Autonomous vehicles; Roads; Annotations; Trajectory; Indexing; Driving scenario; data storage; data indexing; CLASSIFICATION; INTELLIGENCE; STRATEGY; VEHICLES;
D O I
10.1109/TIV.2022.3215503
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Autonomous driving related researches require the analysis and usage of massive amounts of driving scenario data. Compared to raw data collected by sensors, scenario data provide a preliminary abstraction of driving tasks and processes, explicitly integrate information about the road environment and the dynamic and static attributes of traffic participants, making it easier to conduct task understanding and decision making. However, many existing driving scenario datasets have the following two problems. First, it is not clear which data fields need to be recorded for driving scenarios. The data storage formats and organization standards are inconsistent. Second, the datasets cannot establish driving scenario indexing effectively. Existing datasets are sparsely annotated and difficult to index, which is detrimental to data sampling and extraction for machine learning process, thus hindering efficient fusion and reuse. In this paper, we propose MetaScenario, a framework for driving scenario data. We describe driving scenarios and design the centralized and unified data framework for the storage, processing, and indexing of scenario data based on relational database. The concept of atom scenario is proposed and characterized using semantic graphs. We also annotate and classify behaviors and interactions of traffic participants in atom scenarios by extracting the spatiotemporal evolution of semantic information. The annotation facilitates the indexing and extraction of data. The scenario datasets are further evaluated via the data distribution and annotation statistics. MetaScenario can provide researchers with convenient tools for scenario data extraction and important analytical references.
引用
收藏
页码:1156 / 1175
页数:20
相关论文
共 86 条
  • [51] Mylavarapu S, 2020, IEEE INT VEH SYM, P321, DOI [10.1109/iv47402.2020.9304822, 10.1109/IV47402.2020.9304822]
  • [52] End-to-End Autonomous Driving With Semantic Depth Cloud Mapping and Multi-Agent
    Natan, Oskar
    Miura, Jun
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 557 - 571
  • [53] A Multimodality Fusion Deep Neural Network and Safety Test Strategy for Intelligent Vehicles
    Nie, Jian
    Yan, Jun
    Yin, Huilin
    Ren, Lei
    Meng, Qian
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (02): : 310 - 322
  • [54] Fault-Tolerant Cooperative Driving at Signal-Free Intersections
    Pei, Huaxin
    Zhang, Jiawei
    Zhang, Yi
    Pei, Xin
    Feng, Shuo
    Li, Li
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 121 - 134
  • [55] Deep Multi-Task Learning for Joint Localization, Perception, and Prediction
    Phillips, John
    Martinez, Julieta
    Barsan, Ioan Andrei
    Casas, Sergio
    Sadat, Abbas
    Urtasun, Raquel
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4677 - 4687
  • [56] Poggenhans F, 2018, IEEE INT C INTELL TR, P1672, DOI 10.1109/ITSC.2018.8569929
  • [57] Unsupervised object detection with scene-adaptive concept learning
    Pu, Shiliang
    Zhao, Wei
    Chen, Weijie
    Yang, Shicai
    Xie, Di
    Pan, Yunhe
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (05) : 638 - 651
  • [58] Queiroz R, 2019, IEEE INT VEH SYM, P287, DOI 10.1109/IVS.2019.8814107
  • [59] Rodarius C., 2015, ADAPTIVE IP
  • [60] Schuldt F., 2017, THESIS TECH U BRAUNS