Context-driven detection of distracted driving using images from in-car cameras

被引:14
作者
Dey, Arup Kanti [1 ]
Goel, Bharti [1 ]
Chellappan, Sriram [1 ]
机构
[1] Univ S Florida, Dept Comp Sci & Engn, 4202 E Fowler Ave,ENG 030, Tampa, FL 33620 USA
关键词
Distracted driving; Object detection; Deep learning; AI; Convolutional neural networks; Human-centered computing;
D O I
10.1016/j.iot.2021.100380
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Distracted driving on roads has been a perennial problem. There is increasing consensus now among various stakeholders that this practice will not be eliminated with mere warnings from subject matter experts. Instead, these warnings must also be augmented with appropriate technological assistance to facilitate safer driving. There has been an urgent interest in the community to devise newer technologies for detecting when drivers are distracted on roads. In this paper, we design a computer vision techniques that process image data recorded from inside of cars to automatically infer when subjects are driving distracted. However, our innovation lies in adding context to the predictions. We do so, by first detecting and localizing a number of objects in cars that contribute to distracted driving (e.g., hands, smartphones, radio etc.) from images. Then, we process the relative locations of these objects using machine learning algorithms within an image to make predictions on distracted driving. We believe that our proposed context-driven approach is unique. We expect it to better facilitate correction of distracted driving, when real-time feedback to subjects come with appropriate contextual interpretation of the specific aspects that contributed to distracted driving. Performance evaluations of our techniques reveal a) mAP score of 63.90 for an IoU of 0.5 in object localization; and b) an overall accuracy of 94% in detecting instances of distracted driving based on object localization. Processing time incurred by our technique is around 200ms only. As such, we believe that our system is accurate, fast, practical and context-aware also. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 14 条
[1]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[2]  
Dey A.K., 2020, INT C BROADB WIR COM, P76
[3]  
Eraqi H.M., 2017, ARXIV PREPRINT ARXIV
[4]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[5]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[6]  
Leekha M, 2019, 2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), P171, DOI [10.1109/BigMM.2019.00034, 10.1109/BigMM.2019.00-28]
[7]  
Mase JM, 2020, I C INF COMM TECH CO, P1, DOI 10.1109/ICTC49870.2020.9289588
[8]   Detecting distraction of drivers using Convolutional Neural Network [J].
Masood, Sarfaraz ;
Rai, Abhinav ;
Aggarwal, Aakash ;
Doja, M. N. ;
Ahmad, Musheer .
PATTERN RECOGNITION LETTERS, 2020, 139 :79-85
[9]  
Moslemi Negar, 2019, 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA), P145, DOI 10.1109/PRIA.2019.8786012
[10]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149