Feature Consistency Learning for Anomaly Detection

被引:4
作者
Li, Huimin [1 ]
Hu, Junlin [1 ]
机构
[1] Beihang Univ, Sch Software, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; feature consistency (FC); feature learning; knowledge distillation;
D O I
10.1109/TIM.2024.3522399
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Anomaly detection in industrial images is a challenging automated vision inspection task. Given an input image, it is essential to know not only whether or not it is abnormal, but also to locate the anomaly. Currently, knowledge distillation-based teacher-student (T-S) networks have nearly saturated image-level anomaly detection on publicly available datasets, however, pixel-level anomaly localization is still very tough. To address this problem, we propose a spatial neighboring coding (SNC) module that facilitates the localization of anomalies by encoding the contextual information of the neighborhood of each element in feature space. Our SNC can be easily plugged into diverse T-S network-based anomaly detectors to improve their performance. Subsequently, we propose a feature consistency learning (FCL) method that learns low-level and high-level feature consistencies in a unified framework for anomaly detection tasks. The proposed FCL is capable of achieving more accurate anomaly localization by imposing consistency constraints on the features extracted from the T-S network. Experimental results on benchmark datasets for industrial image anomaly detection show that our FCL method achieves image-level Area Under Receiver Operator Characteristic Curve (AUROC) of 99.1% and 98.4%, pixel-level AUROC of 97.7% and 99.0%, and pixel-level Area Under Per-Region Overlap (AUPRO) of 97.4% and 95.5% on MVTec AD and VisA datasets, respectively, demonstrating the effectiveness of our FCL.
引用
收藏
页数:9
相关论文
共 46 条
[1]   EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies [J].
Batzner, Kilian ;
Heckler, Lars ;
Koenig, Rebecca .
2024 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION, WACV 2024, 2024, :127-137
[2]   Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4182-4191
[3]   MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9584-9592
[4]   Mixed supervision for surface-defect detection: From weakly to fully supervised learning [J].
Bozic, Jakob ;
Tabernik, Domen ;
Skocaj, Danijel .
COMPUTERS IN INDUSTRY, 2021, 129
[5]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[6]  
Cover TM, 2006, Elements of information theory
[7]   Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection [J].
Ding, Choubo ;
Pang, Guansong ;
Shen, Chunhua .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :7378-7388
[8]  
Dosovitskiy A., 2021, P INT C LEARN REPR
[9]   Knowledge Distillation: A Survey [J].
Gou, Jianping ;
Yu, Baosheng ;
Maybank, Stephen J. ;
Tao, Dacheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (06) :1789-1819
[10]   Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection [J].
Gu, Zhihao ;
Liu, Liang ;
Chen, Xu ;
Yi, Ran ;
Zhang, Jiangning ;
Wang, Yabiao ;
Wang, Chengjie ;
Shu, Annan ;
Jiang, Guannan ;
Ma, Lizhuang .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :16355-16363