Pedestrian Group Re-Identification and Trajectory Prediction Through Zone-Based Clustering

被引:0
作者
Chen, Mingzuoyang [1 ]
Banitaan, Shadi [1 ]
Maleki, Mina [1 ]
机构
[1] Univ Detroit Mercy, Dept Elect & Comp Engn & Comp Sci, Detroit, MI 48221 USA
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Trajectory; Pedestrians; Accuracy; Predictive models; Feature extraction; Object detection; Long short term memory; Cameras; Computer vision; Identification of persons; Hungarian algorithm; human view camera; LSTM; re-identification; trajectory prediction; zone-based group detection; NETWORK; LSTM;
D O I
10.1109/ACCESS.2024.3428438
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Pedestrian trajectory prediction is a critical aspect of computer vision, aimed at predicting a pedestrian's future locations by analyzing their past movements. Traditional trajectory prediction models primarily focus on individuals, which can be challenging in densely populated areas due to occlusions. These occlusions not only complicate the re-identification of pedestrians once they reappear but also increase processing times due to the more complex procedures and the greater number of objects involved. However, a common observation is that pedestrians often travel in groups. This insight led us to propose a novel approach, predicting the future trajectories of pedestrian groups instead of individuals. This strategy effectively addresses the complexities of predicting movements in crowded environments and the issues related to pedestrian occlusion. In this work, we introduced a distinctive methodology for identifying pedestrian groups, re-identifying them, and predicting their future trajectories. Our approach, unlike traditional state-of-the-art re-identification and trajectory prediction methods of individual pedestrians, focuses on re-identifying pedestrian groups and predicting their future trajectories while emphasizing processing time reduction with great accuracy. The process started with object detection to ascertain pedestrian coordinates. Subsequently, a zone-based clustering method was employed to form groups. Following this, a specific group re-identification was utilized to construct continuous trajectories for these groups, rather than for individual pedestrians. Finally, the group trajectory prediction technique was applied to estimate the future movements of these groups. Both the object detection and group detection methods were applied every five frames to generate these trajectories. The effectiveness of our approach has been validated using several evaluation metrics, including Average Displacement Error (ADE), Final Displacement Error (FDE), Cumulative Matching Characteristics (CMC) scores, IDF1 scores, and IDs, all assessed using the MOT17 dataset. These evaluations not only confirm the practicality and accuracy of our method in predicting pedestrian trajectories but also highlight its efficiency, with a reduction in processing time by 7.6% compared to individual trajectory prediction. This efficiency demonstrates the potential of our method for real-time applications and underscores its capacity to prevent accidents.
引用
收藏
页码:101549 / 101562
页数:14
相关论文
共 64 条
[11]   Behavior-Aware Pedestrian Trajectory Prediction in Ego-Centric Camera Views with Spatio-Temporal Ego-Motion Estimation [J].
Czech, Phillip ;
Braun, Markus ;
Kressel, Ulrich ;
Yang, Bin .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2023, 5 (03) :957-978
[12]  
Dai Z., 2022, P AS C COMP VIS, P1142, DOI DOI 10.1007/978-3-031-26351-4_20
[13]   Learning Structured Representations of Spatial and Interactive Dynamics for Trajectory Prediction in Crowded Scenes [J].
Davchev, Todor ;
Burke, Michael ;
Ramamoorthy, Subramanian .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) :707-714
[14]   How to Increase Automated Vehicles' Acceptance through In-Vehicle Interaction Design: A Review [J].
Detjen, Henrik ;
Faltaous, Sarah ;
Pfleging, Bastian ;
Geisler, Stefan ;
Schneegass, Stefan .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2021, 37 (04) :308-330
[15]   Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving [J].
Fadadu, Sudeep ;
Pandey, Shreyash ;
Hegde, Darshan ;
Shi, Yi ;
Chou, Fang-Chieh ;
Djuric, Nemanja ;
Vallespi-Gonzalez, Carlos .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :3292-3300
[16]   Deep encoder-decoder-NN: A deep learning-based autonomous vehicle trajectory prediction and correction model [J].
Fei Hui ;
Cheng Wei ;
Wei ShangGuan ;
Ando, Ryosuke ;
Shan Fang .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2022, 593
[17]  
Feng WT, 2020, Arxiv, DOI arXiv:2009.10338
[18]   Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion [J].
Gu, Tianpei ;
Chen, Guangyi ;
Li, Junlong ;
Lin, Chunze ;
Rao, Yongming ;
Zhou, Jie ;
Lu, Jiwen .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17092-17101
[19]   TransReID: Transformer-based Object Re-Identification [J].
He, Shuting ;
Luo, Hao ;
Wang, Pichao ;
Wang, Fan ;
Li, Hao ;
Jiang, Wei .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :14993-15002
[20]   Attention-LSTM based prediction model for aircraft 4-D trajectory [J].
Jia, Peiyan ;
Chen, Huiping ;
Zhang, Lei ;
Han, Daojun .
SCIENTIFIC REPORTS, 2022, 12 (01)