A Cooperative Vehicle-Infrastructure System for Road Hazards Detection With Edge Intelligence

被引:38
作者
Chen, Chen [1 ]
Yao, Guorun [1 ]
Liu, Lei [1 ]
Pei, Qingqi [1 ]
Song, Houbing [2 ]
Dustdar, Schahram [3 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Univ Maryland Baltimore Cty UMBC, Dept Informat Syst, Baltimore, MD 21250 USA
[3] TU Wien, Distributed Syst Grp, A-1040 Vienna, Austria
基金
中国国家自然科学基金;
关键词
Roads; Image edge detection; Feature extraction; Accidents; Data models; Task analysis; Training; Cooperative vehicle-infrastructure system; edge intelligence; road hazards detection; meta-learning; knowledge distillation; ACTION RECOGNITION; KNOWLEDGE DISTILLATION; CHALLENGES; VIDEO;
D O I
10.1109/TITS.2023.3241251
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road hazards (RH) have always been the cause of many serious traffic accidents. These have posed a threat to the safety of drivers, passengers, and pedestrians, and have also resulted in significant losses to people and even to the economies of countries. Hence, road hazards detection (RHD) could play an essential role in intelligent transportation systems (ITSITS). The cooperative vehicle-infrastructure systems (CVIS) coordinate the communication between vehicles and roadside infrastructures. Onboard computing devices (OCD), then, make fast analyses and decisions based on road conditions. In this study, an RHD solution based on CVIS is proposed. Firstly, a high-performance heavy action detection model is selected. Using a meta-learning paradigm, critical features are generalized from a few-shot RH data. Secondly, we designed a lightweight RHD model to ensure its smooth inference on an OCD. Thirdly, we use a knowledge distillation (KD) framework to progressively distill the features of the complex model and the privileged information of the data into the lightweight one. Experimental results demonstrate that the model can effectively detect RH and obtain an accuracy of 90.2% with an inference time of 14.7ms.
引用
收藏
页码:5186 / 5198
页数:13
相关论文
共 109 条
[1]   ViViT: A Video Vision Transformer [J].
Arnab, Anurag ;
Dehghani, Mostafa ;
Heigold, Georg ;
Sun, Chen ;
Lucic, Mario ;
Schmid, Cordelia .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :6816-6826
[2]   A Taxonomy and Survey of Edge Cloud Computing for Intelligent Transportation Systems and Connected Vehicles [J].
Arthurs, Peter ;
Gillam, Lee ;
Krause, Paul ;
Wang, Ning ;
Halder, Kaushik ;
Mouzakitis, Alexandros .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :6206-6221
[3]  
Bertasius G, 2021, PR MACH LEARN RES, V139
[4]   Efficient Video Classification Using Fewer Frames [J].
Bhardwaj, Shweta ;
Srinivasan, Mukundhan ;
Khapra, Mitesh M. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :354-363
[5]   Video Action Recognition for Lane-Change Classification and Prediction of Surrounding Vehicles [J].
Biparva, Mahdi ;
Fernandez-Llorca, David ;
Izquierdo Gonzalo, Ruben ;
Tsotsos, John K. .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2022, 7 (03) :569-578
[6]  
Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
[7]   Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset [J].
Carreira, Joao ;
Zisserman, Andrew .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4724-4733
[8]   A Multihop Task Offloading Decision Model in MEC-Enabled Internet of Vehicles [J].
Chen, Chen ;
Zeng, Yini ;
Li, Huan ;
Liu, Yangyang ;
Wan, Shaohua .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (04) :3215-3230
[9]   An edge intelligence empowered flooding process prediction using Internet of things in smart city [J].
Chen, Chen ;
Jiang, Jiange ;
Zhou, Yang ;
Lv, Ning ;
Liang, Xiaoxu ;
Wan, Shaohua .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2022, 165 :66-78
[10]   Car crash detection using ensemble deep learning and multimodal data from dashboard cameras [J].
Choi, Jae Gyeong ;
Kong, Chan Woo ;
Kim, Gyeongho ;
Lim, Sunghoon .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 183