Diffusion Models-Based Purification for Common Corruptions on Robust 3D Object Detection

被引:2
作者
Cai, Mumuxin [1 ]
Wang, Xupeng [2 ]
Sohel, Ferdous [3 ]
Lei, Hang [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Software Engn, Chengdu 610054, Peoples R China
[2] Univ Elect Sci & Technol, Lab Intelligent Collaborat Comp, Chengdu 610054, Peoples R China
[3] Murdoch Univ, Sch Informat Technol, Perth, WA 6150, Australia
基金
中国国家自然科学基金;
关键词
3D object detection; LiDAR scene data; point cloud; diffusion models; defence strategy; adversarial robustness;
D O I
10.3390/s24165440
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
LiDAR sensors have been shown to generate data with various common corruptions, which seriously affect their applications in 3D vision tasks, particularly object detection. At the same time, it has been demonstrated that traditional defense strategies, including adversarial training, are prone to suffering from gradient confusion during training. Moreover, they can only improve their robustness against specific types of data corruption. In this work, we propose LiDARPure, which leverages the powerful generation ability of diffusion models to purify corruption in the LiDAR scene data. By dividing the entire scene into voxels to facilitate the processes of diffusion and reverse diffusion, LiDARPure overcomes challenges induced from adversarial training, such as sparse point clouds in large-scale LiDAR data and gradient confusion. In addition, we utilize the latent geometric features of a scene as a condition to assist the generation of diffusion models. Detailed experiments show that LiDARPure can effectively purify 19 common types of LiDAR data corruption. Further evaluation results demonstrate that it can improve the average precision of 3D object detectors to an extent of 20% in the face of data corruption, much higher than existing defence strategies.
引用
收藏
页数:21
相关论文
共 49 条
  • [1] Bijelic Mario, 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Proceedings, P11679, DOI 10.1109/CVPR42600.2020.01170
  • [2] Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving
    Cao, Yulong
    Xiao, Chaowei
    Cyr, Benjamin
    Zhou, Yimeng
    Park, Won
    Rampazzi, Sara
    Chen, Qi Alfred
    Fu, Kevin
    Mao, Z. Morley
    [J]. PROCEEDINGS OF THE 2019 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY (CCS'19), 2019, : 2267 - 2281
  • [3] Croce F, 2020, PR MACH LEARN RES, V119
  • [4] Dong XY, 2020, PROC CVPR IEEE, P11513, DOI 10.1109/CVPR42600.2020.01153
  • [5] Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Driving
    Dong, Yinpeng
    Kang, Caixin
    Zhang, Jinlai
    Zhu, Zijian
    Wang, Yikai
    Yang, Xiao
    Su, Hang
    Wei, Xingxing
    Zhu, Jun
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1022 - 1032
  • [6] Point-cloud based 3D object detection and classification methods for self-driving applications: A survey and taxonomy
    Fernandes, Duarte
    Silva, Antonio
    Nevoa, Rafael
    Simoes, Claudia
    Gonzalez, Dibet
    Guevara, Miguel
    Novais, Paulo
    Monteiro, Joao
    Melo-Pinto, Pedro
    [J]. INFORMATION FUSION, 2021, 68 : 161 - 191
  • [7] Vision meets robotics: The KITTI dataset
    Geiger, A.
    Lenz, P.
    Stiller, C.
    Urtasun, R.
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) : 1231 - 1237
  • [8] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [9] Gowal Sven, 2021, Advances in Neural Information Processing Systems, V34
  • [10] Guo MH, 2022, ADV NEUR IN