Real-Time Evaluation of Perception Uncertainty and Validity Verification of Autonomous Driving

被引:3
作者
Yang, Mingliang [1 ]
Jiang, Kun [1 ]
Wen, Junze [1 ]
Peng, Liang [1 ]
Yang, Yanding [1 ]
Wang, Hong [1 ]
Yang, Mengmeng [1 ]
Jiao, Xinyu [1 ]
Yang, Diange [1 ]
机构
[1] Tsinghua Univ, Sch Vehicle & Mobil, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
autonomous driving; uncertainty estimation; deep learning; perception uncertainty; object detection; spatial uncertainty; deep ensemble; prediction entropy;
D O I
10.3390/s23052867
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Deep neural network algorithms have achieved impressive performance in object detection. Real-time evaluation of perception uncertainty from deep neural network algorithms is indispensable for safe driving in autonomous vehicles. More research is required to determine how to assess the effectiveness and uncertainty of perception findings in real-time.This paper proposes a novel real-time evaluation method combining multi-source perception fusion and deep ensemble. The effectiveness of single-frame perception results is evaluated in real-time. Then, the spatial uncertainty of the detected objects and influencing factors are analyzed. Finally, the accuracy of spatial uncertainty is validated with the ground truth in the KITTI dataset. The research results show that the evaluation of perception effectiveness can reach 92% accuracy, and a positive correlation with the ground truth is found for both the uncertainty and the error. The spatial uncertainty is related to the distance and occlusion degree of detected objects.
引用
收藏
页数:21
相关论文
共 44 条
[1]   EDGE INSERTION FOR OPTIMAL TRIANGULATIONS [J].
BERN, M ;
EDELSBRUNNER, H ;
EPPSTEIN, D ;
MITCHELL, S ;
TAN, TS .
DISCRETE & COMPUTATIONAL GEOMETRY, 1993, 10 (01) :47-65
[2]   Anomaly Detection in Autonomous Driving: A Survey [J].
Bogdoll, Daniel ;
Nitsche, Maximilian ;
Zoellner, J. Marius .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :4487-4498
[3]   LiDAR-based Object Detection Failure Tolerated Autonomous Driving Planning System [J].
Cao, Zhong ;
Liu, Jiaxin ;
Zhou, Weitao ;
Jiao, Xinyu ;
Yang, Diange .
2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, :122-128
[4]   Platoon Separation Strategy Optimization Method Based on Deep Cognition of a Drivers Behavior at Signalized Intersections [J].
Chen, Junjie ;
Sun, Jian .
IEEE ACCESS, 2020, 8 :17779-17791
[5]   Joint Optimization of Sensing, Decision-Making and Motion-Controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach [J].
Chen, Longquan ;
He, Ying ;
Wang, Qiang ;
Pan, Weike ;
Ming, Zhong .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) :4642-4654
[6]  
Cosgun A, 2017, IEEE INT VEH SYM, P1811, DOI 10.1109/IVS.2017.7995969
[7]   Towards a Framework to Manage Perceptual Uncertainty for Safe Automated Driving [J].
Czarnecki, Krzysztof ;
Salay, Rick .
COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2018, 2018, 11094 :439-445
[8]  
Fekete SP, 2012, Arxiv, DOI arXiv:1208.0202
[9]   Labels Are Not Perfect: Inferring Spatial Uncertainty in Object Detection [J].
Feng, Di ;
Wang, Zining ;
Zhou, Yiyang ;
Rosenbaum, Lars ;
Timm, Fabian ;
Dietmayer, Klaus ;
Tomizuka, Masayoshi ;
Zhan, Wei .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) :9981-9994
[10]   A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving [J].
Feng, Di ;
Harakeh, Ali ;
Waslander, Steven L. ;
Dietmayer, Klaus .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) :9961-9980