Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptors

被引:28
作者
Bergmann, Paul [1 ]
Sattlegger, David [2 ]
机构
[1] Tech Univ Munich, MVTec Software GmbH, Munich, Germany
[2] MVTec Software GmbH, Munich, Germany
来源
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) | 2023年
关键词
SURFACE;
D O I
10.1109/WACV56688.2023.00264
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a new method for the unsupervised detection of geometric anomalies in high-resolution 3D point clouds. In particular, we propose an adaptation of the established student-teacher anomaly detection framework to three dimensions. A student network is trained to match the output of a pretrained teacher network on anomaly-free point clouds. When applied to test data, regression errors between the teacher and the student allow reliable localization of anomalous structures. To construct an expressive teacher network that extracts dense local geometric descriptors, we introduce a novel self-supervised pretraining strategy. The teacher is trained by reconstructing local receptive fields and does not require annotations. Extensive experiments on the comprehensive MVTec 3D Anomaly Detection dataset highlight the effectiveness of our approach, which outperforms the existing methods by a large margin. Ablation studies show that our approach meets the requirements of practical applications regarding performance, runtime, and memory consumption.
引用
收藏
页码:2612 / 2622
页数:11
相关论文
共 50 条
  • [21] Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid
    Tam, Gary K. L.
    Cheng, Zhi-Quan
    Lai, Yu-Kun
    Langbein, Frank C.
    Liu, Yonghuai
    Marshall, David
    Martin, Ralph R.
    Sun, Xian-Fang
    Rosin, Paul L.
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2013, 19 (07) : 1199 - 1217
  • [22] QUALITY OF 3D POINT CLOUDS FROM HIGHLY OVERLAPPING UAV IMAGERY
    Haala, Norbert
    Cramer, Michael
    Rothermel, Mathias
    UAV-G2013, 2013, : 183 - 188
  • [23] Robust Feature Matching for 3D Point Clouds with Progressive Consistency Voting
    Quan, Siwen
    Yin, Kunpeng
    Ye, Kaixiao
    Nan, Kechen
    SENSORS, 2022, 22 (20)
  • [24] Depth grid-based local description for 3D point clouds
    Sa, Jiming
    Zhang, Xuecheng
    Zhang, Chi
    Song, Yuyan
    Ding, Liwei
    Huang, Yechen
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (05) : 4085 - 4102
  • [25] A Mars Local Terrain Matching Method Based on 3D Point Clouds
    Wang, Binliang
    Zhao, Shuangming
    Guo, Xinyi
    Yu, Guorong
    REMOTE SENSING, 2024, 16 (09)
  • [26] Visual Saliency and Quality Evaluation for 3D Point Clouds and Meshes: An Overview
    Lin, Weisi
    Lee, Sanghoon
    APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2022, 11 (01)
  • [27] 4-Plane congruent sets for automatic registration of as-is 3D point clouds with 3D BIM models
    Bueno, Martin
    Bosche, Frederic
    Gonzalez-Jorge, Higinio
    Martinez-Sanchez, Joaquin
    Arias, Pedro
    AUTOMATION IN CONSTRUCTION, 2018, 89 : 120 - 134
  • [28] On shortened 3D local binary descriptors
    Quan, Siwen
    Ma, Jie
    INFORMATION SCIENCES, 2020, 510 : 33 - 49
  • [29] Automatic co-registration of 3D multi-sensor point clouds
    Persad, Ravi Ancil
    Armenakis, Costas
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2017, 130 : 162 - 186
  • [30] Non-rigid registration of 3D point clouds under isometric deformation
    Ge, Xuming
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2016, 121 : 192 - 202