Advancing unsupervised anomaly detection with normalizing flow and multi-scale ensemble learning

被引:0
|
作者
Campos-Romero, Miguel [1 ,2 ]
Carranza-Garcia, Manuel [2 ]
Riquelme, Jose C. [2 ]
机构
[1] LMI Technol Inc, 9200 Glenlyon Pkwy, Burnaby, BC V5J 5J8, Canada
[2] Univ Seville, Div Comp Sci, Av Reina Mercedes S-N, Seville 41012, Spain
关键词
Anomaly detection; Novelty detection; Deep learning; Normalizing flow; Unsupervised learning;
D O I
10.1016/j.engappai.2024.109088
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual anomaly detection plays a crucial role in manufacturing to ensure product quality by identifying image patterns that deviate from the expected ones. Existing methods that rely on distribution estimation struggle with the complexity of real-world images, resulting in complex and inefficient procedures. This study leverages normalizing flow techniques to address the cold start anomaly detection problem, where no prior examples of anomalies are available during the training phase. In such scenarios, models must learn exclusively from defect-free images and still accurately identify anomalies. We propose a novel unsupervised multi-scale and multi-semantic normalizing flow model, enhanced with an ensemble of neural networks, to detect anomalies based on their feature distributions. Our model estimates the likelihood of non-defective features, identifying anomalies as out-of-distribution values. Extensive experiments on three state-of-the-art anomaly detection datasets demonstrate that our proposal achieves superior AUROC performance and improves computational efficiency compared to existing approaches. Furthermore, we validate the robustness and adaptability of our proposal through low-shot training experiments using only 20% of available training data, highlighting its potential as an efficient solution for cold start anomaly detection.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] Robust log anomaly detection based on contrastive learning and multi-scale MASS
    Xuejie Wang
    Qilei Cao
    Qiaozheng Wang
    Zhiying Cao
    Xiuguo Zhang
    Peipeng Wang
    The Journal of Supercomputing, 2022, 78 : 17491 - 17512
  • [22] Robust log anomaly detection based on contrastive learning and multi-scale MASS
    Wang, Xuejie
    Cao, Qilei
    Wang, Qiaozheng
    Cao, Zhiying
    Zhang, Xiuguo
    Wang, Peipeng
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (16): : 17491 - 17512
  • [23] Flow Graph Anomaly Detection Based on Unsupervised Learning
    Yang, Zhengqiang
    Tian, Junwei
    Li, Ning
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [24] Flow Graph Anomaly Detection Based on Unsupervised Learning
    Yang, Zhengqiang
    Tian, Junwei
    Li, Ning
    Mobile Information Systems, 2022, 2022
  • [25] A multi-scale unsupervised learning for deformable image registration
    Shao, Shuwei
    Pei, Zhongcai
    Chen, Weihai
    Zhu, Wentao
    Wu, Xingming
    Zhang, Baochang
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (01) : 157 - 166
  • [26] A multi-scale unsupervised learning for deformable image registration
    Shuwei Shao
    Zhongcai Pei
    Weihai Chen
    Wentao Zhu
    Xingming Wu
    Baochang Zhang
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 157 - 166
  • [27] Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning
    Duan, Jingcan
    Zhang, Pei
    Wang, Siwei
    Hu, Jingtao
    Jin, Hu
    Zhang, Jiaxin
    Zhou, Haifang
    Liu, Xinwang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7502 - 7511
  • [28] Anomaly detection with multi-scale pyramid grid templates
    Shifeng Li
    Yan Cheng
    Liuyang Zhao
    Yue Wang
    Multimedia Tools and Applications, 2024, 83 : 9929 - 9947
  • [29] MULTI-SCALE SPARSE CODING WITH ANOMALY DETECTION AND CLASSIFICATION
    Akhondi-Asl, Hojjat
    Nelson, James D. B.
    2016 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2016,
  • [30] Anomaly detection with multi-scale pyramid grid templates
    Li, Shifeng
    Cheng, Yan
    Zhao, Liuyang
    Wang, Yue
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 9929 - 9947