Outlier-Probability-Based Feature Adaptation for Robust Unsupervised Anomaly Detection on Contaminated Training Data

被引:0
作者
Zhou, Jianxiong [1 ]
Wu, Ying [1 ]
机构
[1] Northwestern Univ, Dept Elect & Comp Engn, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
Feature extraction; Anomaly detection; Image reconstruction; Training data; Training; Data models; Semantics; outlier detection; unsupervised learning; deep feature modeling; SEGMENTATION; SUPPORT;
D O I
10.1109/TCSVT.2024.3408034
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the realm of large-scale industrial manufacturing, the precise detection of defective parts stands as a critical imperative. While current unsupervised anomaly detection algorithms exhibit commendable accuracy when applied to clean training datasets, their susceptibility to contaminated training data limits their real-world efficacy. In response to this challenge, this paper proposes a novel Outlier-Probability-Based Feature Adaptation (OPFA) network to realize robust unsupervised anomaly detection on contaminated training data. This method distinguishes itself by maintaining both high accuracy and robustness in the face of contaminated training data, enabling effective learning of discriminative features for anomaly detection. Specifically, the model enhances feature representations through the contraction of normal features and the contrast between normal and outlier features. Our methodology employs an iterative mechanism, featuring three core designs. First, outlier detection evaluates the outlier probabilities of current feature embeddings, providing a basis for subsequent improvements. Second, Gaussian Mixture Model (GMM) is leveraged to model the distributions of normal feature embeddings. Third, the adaptive network refines feature representations based on the GMM models and outlier scores of feature embeddings. Ablation experiments underscore the effectiveness of each component within our model. Furthermore, our approach outperforms other state-of-the-art methods on three benchmark datasets, demonstrating a notable advantage especially in scenarios with contaminated training data.
引用
收藏
页码:10023 / 10035
页数:13
相关论文
共 66 条
  • [1] Agarwal P. K., 2005, Comb. Comput. Geom., V52, P1
  • [2] GANomaly: Semi-supervised Anomaly Detection via Adversarial Training
    Akcay, Samet
    Atapour-Abarghouei, Amir
    Breckon, Toby P.
    [J]. COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 : 622 - 637
  • [3] Bae J, 2023, IEEE I CONF COMP VIS, P6350, DOI 10.1109/ICCV51070.2023.00586
  • [4] Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images
    Baur, Christoph
    Wiestler, Benedikt
    Albarqouni, Shadi
    Navab, Nassir
    [J]. BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2018, PT I, 2019, 11383 : 161 - 169
  • [5] MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
    Bergmann, Paul
    Fauser, Michael
    Sattlegger, David
    Steger, Carsten
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9584 - 9592
  • [6] LOF: Identifying density-based local outliers
    Breunig, MM
    Kriegel, HP
    Ng, RT
    Sander, J
    [J]. SIGMOD RECORD, 2000, 29 (02) : 93 - 104
  • [7] Chen YH, 2022, AAAI CONF ARTIF INTE, P383
  • [8] Anomaly detection of defects on concrete structures with the convolutional autoencoder
    Chow, J. K.
    Su, Z.
    Wu, J.
    Tan, P. S.
    Mao, X.
    Wang, Y. H.
    [J]. ADVANCED ENGINEERING INFORMATICS, 2020, 45 (45)
  • [9] Cohen N., 2020, ARXIV
  • [10] Cordier A., 2022, ARXIV