Social NSTransformers: Low-Quality Pedestrian Trajectory Prediction

被引:4
作者
Jiang Z. [1 ]
Ma Y. [1 ]
Shi B. [2 ]
Lu X. [1 ]
Xing J. [2 ]
Goncalves N. [3 ]
Jin B. [3 ]
机构
[1] Xi'an Jiaotong-Liverpool University, School of Advanced Technology (SAT), Suzhou
[2] Northeast Forestry University, College of Computer and Control Engineering, Harbin
[3] University of Coimbra, Institute of Systems and Robotics, Department of Electrical and Computer Engineering, Coimbra
来源
IEEE Transactions on Artificial Intelligence | 2024年 / 5卷 / 11期
关键词
Enhanced loss function; generative adversarial network (GAN); nonstationary transformers (NSTransformers); pedestrian trajectory prediction;
D O I
10.1109/TAI.2024.3421175
中图分类号
学科分类号
摘要
This article introduces a novel model for low-quality pedestrian trajectory prediction, the social nonstationary transformers (NSTransformers), that merges the strengths of NSTransformers and spatiotemporal graph transformer (STAR). The model can capture social interaction cues among pedestrians and integrate features across spatial and temporal dimensions to enhance the precision and resilience of trajectory predictions. We also propose an enhanced loss function that combines diversity loss with logarithmic root mean squared error (log-RMSE) to guarantee the reasonableness and diversity of the generated trajectories. This design adapts well to complex pedestrian interaction scenarios, thereby improving the reliability and accuracy of trajectory prediction. Furthermore, we integrate a generative adversarial network (GAN) to model the randomness inherent in pedestrian trajectories. Compared to the conventional standard Gaussian distribution, our GAN approach better simulates the intricate distribution found in pedestrian trajectories, enhancing the trajectory prediction's diversity and robustness. Experimental results reveal that our model outperforms several state-of-the-art methods. This research opens the avenue for future exploration in low-quality pedestrian trajectory prediction. © 2024 IEEE.
引用
收藏
页码:5575 / 5588
页数:13
相关论文
共 51 条
[41]  
Kosaraju V., Martin-Martin R., Reid I., Rezatofighi S.H., Sadeghian A., Savarese S., Social-BiGAT: Multimodal trajectory forecasting using bicycle-GAN and graph attention networks, Proc. 33rd Int. Conf. Neural Inf. Process. Syst., pp. 137-146, (2019)
[42]  
Mohamed A., Qian K., Elhoseiny M., Claudel C., Social-STGCNN: A social spatio-Temporal graph convolutional neural network for human trajectory prediction, Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 14412-14420, (2020)
[43]  
Sun J., Jiang Q., Lu C., Recursive social behavior graph for trajectory prediction, Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 657-666, (2020)
[44]  
Sun H., Zhao Z., Yin Z., He Z., Reciprocal twin networks for pedestrian motion learning and future path prediction, IEEE Trans. Circuits Syst. Video Technol., 32, 3, pp. 1483-1497, (2022)
[45]  
Zhang P., Xue J., Zhang P., Zheng N., Ouyang W., Social-Aware pedestrian trajectory prediction via states refinement LSTM, IEEE Trans. Pattern Anal. Mach. Intell., 44, 5, pp. 2742-2759, (2022)
[46]  
Shi L., Wang L., Zhou S., Hua G., Trajectory unified transformer for pedestrian trajectory prediction, Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), pp. 9641-9650, (2023)
[47]  
Liu Z., He L., Yuan L., Lv K., Zhong R., Chen Y., STAGP: Spatio-Temporal adaptive graph pooling network for pedestrian trajectory prediction, IEEE Robot. Automat. Lett., 9, 3, pp. 2001-2007, (2024)
[48]  
Jin B., Goncalves N., Cruz L., Medvedev I., Yu Y., Wang J., Simulated multimodal deep facial diagnosis, Expert Syst. Appl., 252, (2024)
[49]  
Gao J., Wang H., Shen H., Task failure prediction in cloud data centers using deep learning, IEEE Trans. Services Comput., 15, 3, pp. 1411-1422, (2022)
[50]  
Jin B., Cruz L., Goncalves N., Deep facial diagnosis: Deep transfer learning from face recognition to facial diagnosis, IEEE Access, 8, pp. 123649-123661, (2020)