Interactive Behavior Prediction for Heterogeneous Traffic Participants in the Urban Road: A Graph-Neural-Network-Based Multitask Learning Framework

被引:42
作者
Li, Zirui [1 ]
Gong, Jianwei [1 ]
Lu, Chao [1 ]
Yi, Yangtian [1 ]
机构
[1] Beijing Inst Technol, Sch Mech Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Predictive models; Hidden Markov models; Trajectory; Roads; Mechatronics; IEEE transactions; Three-dimensional displays; Graph neural network (GNN); interactive behavior modeling; multitask learning;
D O I
10.1109/TMECH.2021.3073736
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effectively predicting interactive behaviors of traffic participants in the urban road is the key to successful decision-making and motion planning of intelligent vehicles. In this article, based on the data collected from vehicle on-board sensors, a graph-neural-network-based multitask learning framework (GNN-MTLF) is proposed to accurately predict trajectories of traffic participants with interactive behaviors. The interactive behavior considered in this research includes interactive events and trajectories that are modeled as spatial-temporal graphs using the GNN. Under the GNN-MTLF, the prediction process contains two main parts: recognition of interactive events and prediction of interactive trajectories. An integrated loss function is designed for multitask learning with the purpose of prediction and recognition. The proposed framework is verified using naturalistic driving data in the urban road. Experimental results show a superior performance of the GNN-MTLF compared to baseline methods and the potential for improving the road mobility.
引用
收藏
页码:1339 / 1349
页数:11
相关论文
共 26 条
[1]   Social LSTM: Human Trajectory Prediction in Crowded Spaces [J].
Alahi, Alexandre ;
Goel, Kratarth ;
Ramanathan, Vignesh ;
Robicquet, Alexandre ;
Li Fei-Fei ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :961-971
[2]  
Altché F, 2017, IEEE INT C INTELL TR
[3]  
Aoude G., 2011, Infotech@Aerospace 2011, P1512, DOI DOI 10.2514/6.2011-1512
[4]  
Aoude GS, 2011, IEEE INT VEH SYM, P601, DOI 10.1109/IVS.2011.5940569
[5]   Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks [J].
Gupta, Agrim ;
Johnson, Justin ;
Li Fei-Fei ;
Savarese, Silvio ;
Alahi, Alexandre .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2255-2264
[6]   Interactive Trajectory Prediction of Surrounding Road Users for Autonomous Driving Using Structural-LSTM Network [J].
Hou, Lian ;
Xin, Long ;
Li, Shengbo Eben ;
Cheng, Bo ;
Wang, Wenjun .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (11) :4615-4625
[7]   Structural-RNN: Deep Learning on Spatio-Temporal Graphs [J].
Jain, Ashesh ;
Zamir, Amir R. ;
Savarese, Silvio ;
Saxena, Ashutosh .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5308-5317
[8]  
Kumar P, 2013, IEEE INT VEH SYM, P797, DOI 10.1109/IVS.2013.6629564
[9]   Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety [J].
Laugier, Christian ;
Paromtchik, Igor E. ;
Perrollaz, Mathias ;
Yong, Mao ;
Yoder, John-David ;
Tay, Christopher ;
Mekhnacha, Kamel ;
Negre, Amaury .
IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2011, 3 (04) :4-19
[10]   Generic Tracking and Probabilistic Prediction Framework and Its Application in Autonomous Driving [J].
Li, Jiachen ;
Zhan, Wei ;
Hu, Yeping ;
Tomizuka, Masayoshi .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (09) :3634-3649