Feature Consistency Learning for Anomaly Detection

被引:1
作者
Li, Huimin [1 ]
Hu, Junlin [1 ]
机构
[1] Beihang Univ, Sch Software, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; feature consistency (FC); feature learning; knowledge distillation;
D O I
10.1109/TIM.2024.3522399
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Anomaly detection in industrial images is a challenging automated vision inspection task. Given an input image, it is essential to know not only whether or not it is abnormal, but also to locate the anomaly. Currently, knowledge distillation-based teacher-student (T-S) networks have nearly saturated image-level anomaly detection on publicly available datasets, however, pixel-level anomaly localization is still very tough. To address this problem, we propose a spatial neighboring coding (SNC) module that facilitates the localization of anomalies by encoding the contextual information of the neighborhood of each element in feature space. Our SNC can be easily plugged into diverse T-S network-based anomaly detectors to improve their performance. Subsequently, we propose a feature consistency learning (FCL) method that learns low-level and high-level feature consistencies in a unified framework for anomaly detection tasks. The proposed FCL is capable of achieving more accurate anomaly localization by imposing consistency constraints on the features extracted from the T-S network. Experimental results on benchmark datasets for industrial image anomaly detection show that our FCL method achieves image-level Area Under Receiver Operator Characteristic Curve (AUROC) of 99.1% and 98.4%, pixel-level AUROC of 97.7% and 99.0%, and pixel-level Area Under Per-Region Overlap (AUPRO) of 97.4% and 95.5% on MVTec AD and VisA datasets, respectively, demonstrating the effectiveness of our FCL.
引用
收藏
页数:9
相关论文
共 46 条
  • [1] Batzner K, 2024, IEEE WINT CONF APPL, P127, DOI 10.1109/WACV57701.2024.00020
  • [2] Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings
    Bergmann, Paul
    Fauser, Michael
    Sattlegger, David
    Steger, Carsten
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4182 - 4191
  • [3] MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
    Bergmann, Paul
    Fauser, Michael
    Sattlegger, David
    Steger, Carsten
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9584 - 9592
  • [4] Mixed supervision for surface-defect detection: From weakly to fully supervised learning
    Bozic, Jakob
    Tabernik, Domen
    Skocaj, Danijel
    [J]. COMPUTERS IN INDUSTRY, 2021, 129
  • [5] Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types
    Cha, Young-Jin
    Choi, Wooram
    Suh, Gahyun
    Mahmoudkhani, Sadegh
    Buyukozturk, Oral
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) : 731 - 747
  • [6] Cover TM., 2006, Elements of information theory, DOI [10.1002/0471200611, 978-0-471-24195-9]
  • [7] Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
    Ding, Choubo
    Pang, Guansong
    Shen, Chunhua
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7378 - 7388
  • [8] Dosovitskiy A., 2021, arXiv
  • [9] Knowledge Distillation: A Survey
    Gou, Jianping
    Yu, Baosheng
    Maybank, Stephen J.
    Tao, Dacheng
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (06) : 1789 - 1819
  • [10] Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection
    Gu, Zhihao
    Liu, Liang
    Chen, Xu
    Yi, Ran
    Zhang, Jiangning
    Wang, Yabiao
    Wang, Chengjie
    Shu, Annan
    Jiang, Guannan
    Ma, Lizhuang
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 16355 - 16363