Self-supervised motion forecasting with local information interaction in autonomous driving

被引:0
作者
Lei, Xinyu [1 ]
Liu, Longjun [1 ]
Li, Haoteng [1 ]
Zhang, Haonan [1 ]
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Natl Engn Res Ctr Visual Informat & Applicat, Natl Key Lab Human Machine Hybrid Augmented Intell, Xian 710049, Shaanxi, Peoples R China
关键词
Motion forecasting; Self-supervised learning; Autonomous driving;
D O I
10.1007/s10489-024-06030-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Motion forecasting presents significant challenges critical for ensuring the safety of autonomous driving systems. The accuracy of these forecasts relies heavily on factors such as map topology and the behaviors of vehicles and pedestrians. However, within vast datasets, certain features with unique properties, capable of enhancing representation generalization often remain hidden and overlooked. While self-supervised learning (SSL) has shown promise in uncovering such hidden features through pretext tasks, its application to motion forecasting remains underexplored. In this paper, we propose a novel self-supervised motion forecasting method that exploits the interaction of map topology and actors' maneuvers within localized focal points to generate more informative and generalizable representations for forecasting task. Since intersections, characterized by intricate structures and frequent motion state changes among actors, serve as pivotal locations where the topology of the intersection map profoundly influences actors' intentions to change course, we leverage this interplay by calculating map structure-based actors' attributes, and actors' maneuver-based map attributes. These attributes yield significant advantages for motion forecasting tasks. Experimentally, our proposed method outperforms the baseline on both the challenging large-scale Argoverse benchmark (Chang et al. 2019) and local test, which demonstrates the effectiveness of the fusion of cross-domain information in a local neighborhood.
引用
收藏
页数:13
相关论文
共 44 条
[1]  
Bhattacharyya P, 2022, PR MACH LEARN RES, V205, P1793
[2]   Deep Clustering for Unsupervised Learning of Visual Features [J].
Caron, Mathilde ;
Bojanowski, Piotr ;
Joulin, Armand ;
Douze, Matthijs .
COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 :139-156
[3]  
Chaitanya K., 2020, P ADV NEUR INF PROC, P12546
[4]   Argoverse: 3D Tracking and Forecasting with Rich Maps [J].
Chang, Ming-Fang ;
Lambert, John ;
Sangkloy, Patsorn ;
Singh, Jagjeet ;
Bak, Slawomir ;
Hartnett, Andrew ;
Wang, De ;
Carr, Peter ;
Lucey, Simon ;
Ramanan, Deva ;
Hays, James .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8740-8749
[5]   Trajectory Prediction for Autonomous Driving Based on Structural Informer Method [J].
Chen, Chongpu ;
Chen, Xinbo ;
Guo, Chong ;
Hang, Peng .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 :17452-17463
[6]   Vulnerable Road User Trajectory Prediction for Autonomous Driving Using a Data-Driven Integrated Approach [J].
Chen, Hao ;
Liu, Yinhua ;
Hu, Chuan ;
Zhang, Xi .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (07) :7306-7317
[7]   Incorporating Driving Knowledge in Deep Learning Based Vehicle Trajectory Prediction: A Survey [J].
Ding, Zhezhang ;
Zhao, Huijing .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (08) :3996-4015
[8]   DE-TGN: Uncertainty-Aware Human Motion Forecasting Using Deep Ensembles [J].
Eltouny, Kareem A. ;
Liu, Wansong ;
Tian, Sibo ;
Zheng, Minghui ;
Liang, Xiao .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (03) :2192-2199
[9]   VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation [J].
Gao, Jiyang ;
Sun, Chen ;
Zhao, Hang ;
Shen, Yi ;
Anguelov, Dragomir ;
Li, Congcong ;
Schmid, Cordelia .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11522-11530
[10]   Dynamic Scenario Representation Learning for Motion Forecasting With Heterogeneous Graph Convolutional Recurrent Networks [J].
Gao, Xing ;
Jia, Xiaogang ;
Li, Yikang ;
Xiong, Hongkai .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (05) :2946-2953