Testing Object Detection Models For Autonomous Vehicles Against Hazards

被引:0
|
作者
Zhang, Xiaodong [1 ]
Bao, Jie [1 ]
Shen, Yulong [1 ]
机构
[1] Xidian Univ, Xian, Peoples R China
来源
2024 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS, NANA 2024 | 2024年
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Autonomous Vehicle; Perception System; Testing; Traffic Hazards Generation;
D O I
10.1109/NaNA63151.2024.00095
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Perception systems play a crucial role in ensuring the safety of autonomous vehicles. These systems must be capable of navigating a variety of challenging conditions that could occur during autonomous driving, including natural hazards such as heavy precipitation or raindrops obscuring the camera lens. As a result, it is of utmost importance that these perception systems undergo rigorous testing against these potential hazards, a requirement enforced by many countries' regulatory bodies for human-operated vehicles. However, given the multitude of potential hazard scenarios, each with its own set of adjustable parameters, two significant challenges arise. The first challenge is to devise a systematic and comprehensive method for testing autonomous vehicles against these hazard scenarios, with quantifiable results. The second challenge involves efficiently navigating the vast search space to pinpoint scenarios that could potentially lead to system failure. In our research, we present HazardTesting, a framework for generating a diverse, customizable hazard catalogue for autonomous vehicle perception evaluation. This tool not only measures an AV's hazard testing coverage but also identifies critical adversarial hazards via optimization procedures. Encompassing 70 unique hazards relevant to AV visual perception, HazardTesting employs a Genetic Algorithm for efficient parameter optimization, meeting different testing objectives. Implemented in Unity, a leading 3D engine, it allows comprehensive AV hazard testing. Through extensive experiments on YOLO and Faster RCNN, two prevalent AV perception models, we found substantial room for improvement. Notably, our optimization-based testing outperformed random methods by detecting 182.2% more perceptual errors on average.
引用
收藏
页码:542 / 548
页数:7
相关论文
empty
未找到相关数据