Driver Activity Recognition by Fusing Multi-object and Key Points Detection

被引:0
作者
Pardo-Decimavilla, Pablo [1 ]
Bergasa, Luis M. [1 ]
Lopez-Guillen, Elena [1 ]
Llamazares, Angel [1 ]
Abdeselam, Navil [1 ]
Ocana, Manuel [1 ]
机构
[1] Univ Alcala, Dept Elect, RobeSafe Res Grp, Alcala De Henares, Spain
来源
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE ADVANCES IN ROBOTICS, VOL 1 | 2024年 / 976卷
关键词
advanced driver distraction detection; object detection; pose estimation;
D O I
10.1007/978-3-031-58676-7_12
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Driver distraction recognition plays a fundamental role in road safety. In this paper, we present a modular architecture based on the fusion of key points and object detection for predicting driver's actions. From multi-camera infrared recordings, we will temporarily detect among a variety of actions that lead to distractions. Our system detects objects of interest and extracts key points from the driver. They are merged by generating features that relate them and processed with a ML-based classification algorithm. Finally, filters are applied to reduce bounces and add temporal context to the detections. Our proposal has been validated on two state-of-the-art datasets for driving distractions. Through several experiments we show that fusion substantially improves related action inference and improves domain adaptation. In addition, our framework is lightweight, explainable and has a low latency as it performs frame-by-frame inference. The modularity of the network allows us to upgrade parts independently or eliminate a camera without having to modify the entire network.
引用
收藏
页码:142 / 154
页数:13
相关论文
共 50 条
[41]   Super-resolution fusion optimization for poultry detection: a multi-object chicken detection method [J].
Wu, Zhenlong ;
Zhang, Tiemin ;
Fang, Cheng ;
Yang, Jikang ;
Ma, Chuang ;
Zheng, Haikun ;
Zhao, Hongzhi .
JOURNAL OF ANIMAL SCIENCE, 2023, 101
[42]   A Recognition Method of Bactroceraminax(Diptera:Tephritidae) Grooming Behavior via a Multi-Object Tracking and Spatio-Temporal Feature Detection Model [J].
Hong, Shengbing ;
Zhan, Wei ;
Dong, Tianyu ;
She, Jinhui ;
Min, Chao ;
Huang, Huazi ;
Sun, Yong .
JOURNAL OF INSECT BEHAVIOR, 2022, 35 (04) :67-81
[43]   A Recognition Method of Bactroceraminax(Diptera:Tephritidae) Grooming Behavior via a Multi-Object Tracking and Spatio-Temporal Feature Detection Model [J].
Shengbing Hong ;
Wei Zhan ;
Tianyu Dong ;
Jinhui She ;
Chao Min ;
Huazi Huang ;
Yong Sun .
Journal of Insect Behavior, 2022, 35 :67-81
[44]   3D Multi-object Tracking Based on Simultaneous Optimization of Object Detection and Scene Flow Estimation [J].
Wang, Guangming ;
Song, Liang ;
Shen, Yueling ;
Wang, Hesheng .
Jiqiren/Robot, 2024, 46 (05) :554-561
[45]   Human Activity Recognition Using Visual Object Detection [J].
Pienaar, Schalk Wilhelm ;
Malekian, Reza .
2019 IEEE 2ND WIRELESS AFRICA CONFERENCE (WAC), 2019, :85-89
[46]   Multi-object surface roughness grade detection based on Faster R-CNN [J].
Su, Jinzhao ;
Yi, Huaian ;
Ling, Lin ;
Shu, Aihua ;
Lu, Enhui ;
Jiao, Yanming ;
Wang, Shuai .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (01)
[47]   Object detection and multi-object tracking based on optimized deep convolutional neural network and unscented Kalman filtering [J].
Jaganathan, Thirumalai ;
Panneerselvam, Anandan ;
Kumaraswamy, Senthil Kumar .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (25)
[48]   Personnel Monitoring in Shipboard Surveillance Using Improved Multi-Object Detection and Tracking Algorithm [J].
Li, Yiming ;
Zhang, Bin ;
Liu, Yichen ;
Wang, Huibing ;
Zhang, Shibo .
SENSORS, 2024, 24 (17)
[49]   Research progress of detection and multi-object tracking algorithm in intelligent traffic monitoring system [J].
Jin S.-S. ;
Long W. ;
Hu L.-X. ;
Wang T.-Y. ;
Pan H. ;
Jiang L.-H. .
Kongzhi yu Juece/Control and Decision, 2023, 38 (04) :890-901
[50]   A Hard Example Mining Approach for Concealed Multi-Object Detection of Active Terahertz Image [J].
Li, Ling ;
Xue, Fei ;
Liang, Dong ;
Chen, Xiaofei .
APPLIED SCIENCES-BASEL, 2021, 11 (23)