Real-Time Pedestrian Detection and Tracking System Using Deep Learning and Kalman filter: Applications on Embedded Systems in Advanced Driver Assistance Systems

被引:1
作者
Bruno, Diego Renan [1 ]
Osorio, Fernando Santos [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci, Sao Carlos, Brazil
来源
2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE | 2023年
关键词
Smart Cities; Autonomous Vehicles; Advanced Driver Assistance Systems; Computer Vision; Deep Learning;
D O I
10.1109/LARS/SBR/WRE59448.2023.10333032
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present a perception system for assisting robotic vehicles in smart cities, facilitating interaction with pedestrians, cyclists, and other motor vehicles while adhering to local traffic rules, all with the aim of enhancing traffic safety. Multiple Object Tracking (MOT) is a complex and fundamental problem in computer vision for robotic vehicles, requiring individual evaluation of various detected mobile agents to make informed decisions. To address this challenge, we utilize embedded and dedicated hardware systems, along with Deep Learning algorithms, as powerful tools for real-time processing of computer vision. In this work, we developed an Advanced Driver Assistance System (ADAS) with 91.85% (mAP) and 78.2% (IoU) accuracy for MOT using Nvidia's Jetson-Nano and optimized the Deep-SORT YOLOv7 model in conjunction with the Kalman filter algorithm to achieve this capability, and a rate equal to or greater than 50% is already considered relevant for the task of detecting dynamic obstacles.
引用
收藏
页码:549 / 554
页数:6
相关论文
共 14 条
  • [11] Shili Chen, 2019, 2019 IEEE International Conference on Real-time Computing and Robotics (RCAR). Proceedings, P219, DOI 10.1109/RCAR47638.2019.9044027
  • [12] Wojke N, 2017, IEEE IMAGE PROC, P3645, DOI 10.1109/ICIP.2017.8296962
  • [13] Multiple pedestrian tracking under first-person perspective using deep neural network and social force optimization
    Xue, Yongjie
    Ju, Zhiyong
    [J]. OPTIK, 2021, 240 (240):
  • [14] Yang F., 2022, Video object tracking based on YOLOv7 and DeepSORT