A Cooperative Vehicle-Infrastructure System for Road Hazards Detection With Edge Intelligence

被引:38
作者
Chen, Chen [1 ]
Yao, Guorun [1 ]
Liu, Lei [1 ]
Pei, Qingqi [1 ]
Song, Houbing [2 ]
Dustdar, Schahram [3 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Univ Maryland Baltimore Cty UMBC, Dept Informat Syst, Baltimore, MD 21250 USA
[3] TU Wien, Distributed Syst Grp, A-1040 Vienna, Austria
基金
中国国家自然科学基金;
关键词
Roads; Image edge detection; Feature extraction; Accidents; Data models; Task analysis; Training; Cooperative vehicle-infrastructure system; edge intelligence; road hazards detection; meta-learning; knowledge distillation; ACTION RECOGNITION; KNOWLEDGE DISTILLATION; CHALLENGES; VIDEO;
D O I
10.1109/TITS.2023.3241251
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road hazards (RH) have always been the cause of many serious traffic accidents. These have posed a threat to the safety of drivers, passengers, and pedestrians, and have also resulted in significant losses to people and even to the economies of countries. Hence, road hazards detection (RHD) could play an essential role in intelligent transportation systems (ITSITS). The cooperative vehicle-infrastructure systems (CVIS) coordinate the communication between vehicles and roadside infrastructures. Onboard computing devices (OCD), then, make fast analyses and decisions based on road conditions. In this study, an RHD solution based on CVIS is proposed. Firstly, a high-performance heavy action detection model is selected. Using a meta-learning paradigm, critical features are generalized from a few-shot RH data. Secondly, we designed a lightweight RHD model to ensure its smooth inference on an OCD. Thirdly, we use a knowledge distillation (KD) framework to progressively distill the features of the complex model and the privileged information of the data into the lightweight one. Experimental results demonstrate that the model can effectively detect RH and obtain an accuracy of 90.2% with an inference time of 14.7ms.
引用
收藏
页码:5186 / 5198
页数:13
相关论文
共 109 条
[21]   Multi-representation knowledge distillation for audio classification [J].
Gao, Liang ;
Xu, Kele ;
Wang, Huaimin ;
Peng, Yuxing .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) :5089-5112
[22]   A deep learning approach for imbalanced crash data in predicting highway-rail grade crossings accidents [J].
Gao, Lu ;
Lu, Pan ;
Ren, Yihao .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2021, 216 (216)
[23]   StartNet: Online Detection of Action Start in Untrimmed Videos [J].
Gao, Mingfei ;
Xu, Mingze ;
Davis, Larry S. ;
Socher, Richard ;
Xiong, Caiming .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5541-5550
[24]   Knowledge Distillation: A Survey [J].
Gou, Jianping ;
Yu, Baosheng ;
Maybank, Stephen J. ;
Tao, Dacheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (06) :1789-1819
[25]   ADCI-Net: an adaptive discriminative clip identification strategy for fast video action recognition [J].
Guo, Zizhao ;
Zheng, Xiujuan ;
Chun, Xinyi ;
Ying, Sancong .
JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (02)
[26]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[27]  
Hinton G, 2015, Arxiv, DOI arXiv:1503.02531
[28]   Online human action detection and anticipation in videos: A survey [J].
Hu, Xuejiao ;
Dai, Jingzhao ;
Li, Ming ;
Peng, Chenglei ;
Li, Yang ;
Du, Sidan .
NEUROCOMPUTING, 2022, 491 :395-413
[29]   Multi-Modality Self-Distillation for Weakly Supervised Temporal Action Localization [J].
Huang, Linjiang ;
Wang, Liang ;
Li, Hongsheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1504-1519
[30]   Personalized Vehicular Edge Computing in 6G [J].
Hui, Yilong ;
Cheng, Nan ;
Huang, Yuanhao ;
Chen, Rui ;
Xiao, Xiao ;
Li, Changle ;
Mao, Guoqiang .
IEEE NETWORK, 2021, 35 (06) :278-284