HAR-Net: An Hourglass Attention ResNet Network for Dangerous Driving Behavior Detection

被引:0
作者
Qu, Zhe [1 ]
Cui, Lizhen [1 ]
Yang, Xiaohui [2 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250100, Peoples R China
[2] Univ Jinan, Sch Informat Sci & Engn, Jinan 250022, Peoples R China
基金
国家重点研发计划;
关键词
dangerous driving behavior detection; driving assistant; vehicle technology; gesture recognition; deep learning; RECOGNITION;
D O I
10.3390/electronics13061019
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ensuring safety while driving relies heavily on normal driving behavior, making the timely detection of dangerous driving patterns crucial. In this paper, an Hourglass Attention ResNet Network (HAR-Net) is proposed to detect dangerous driving behavior. Uniquely, we separately input optical flow data, RGB data, and RGBD data into the network for spatial-temporal fusion. In the spatial fusion part, we combine ResNet-50 and the hourglass network as the backbone of CenterNet. To improve the accuracy, we add the attention mechanism to the network and integrate center loss into the original Softmax loss. Additionally, a dangerous driving behavior dataset is constructed to evaluate the proposed model. Through ablation and comparative studies, we demonstrate the efficacy of each HAR-Net component. Notably, HAR-Net achieves a mean average precision of 98.84% on our dataset, surpassing other state-of-the-art networks for detecting distracted driving behaviors.
引用
收藏
页数:17
相关论文
共 36 条
[1]   Deep Learning Approach Based on Residual Neural Network and SVM Classifier for Driver's Distraction Detection [J].
Abbas, Tahir ;
Ali, Syed Farooq ;
Mohammed, Mazin Abed ;
Khan, Aadil Zia ;
Awan, Mazhar Javed ;
Majumdar, Arnab ;
Thinnukool, Orawit .
APPLIED SCIENCES-BASEL, 2022, 12 (13)
[2]   Driver Mental Fatigue Detection Based on Head Posture Using New Modified reLU-BiLSTM Deep Neural Network [J].
Ansari, Shahzeb ;
Naghdy, Fazel ;
Du, Haiping ;
Pahnwar, Yasmeen Naz .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) :10957-10969
[3]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, DOI 10.48550/ARXIV.2004.10934]
[4]   Driver Distraction Identification with an Ensemble of Convolutional Neural Networks [J].
Eraqi, Hesham M. ;
Abouelnaga, Yehya ;
Saad, Mohamed H. ;
Moustafa, Mohamed N. .
JOURNAL OF ADVANCED TRANSPORTATION, 2019, 2019
[5]   3D human gesture capturing and recognition by the IMMU-based data glove [J].
Fang, Bin ;
Sun, Fuchun ;
Liu, Huaping ;
Liu, Chunfang .
NEUROCOMPUTING, 2018, 277 :198-207
[6]  
Fitch G.A., 2013, The impact of hand-held and hands-free cell phone use on driving performance and safety-critical event risk
[7]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[8]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) :1904-1916