Advancing unsupervised anomaly detection with normalizing flow and multi-scale ensemble learning

被引:0
|
作者
Campos-Romero, Miguel [1 ,2 ]
Carranza-Garcia, Manuel [2 ]
Riquelme, Jose C. [2 ]
机构
[1] LMI Technol Inc, 9200 Glenlyon Pkwy, Burnaby, BC V5J 5J8, Canada
[2] Univ Seville, Div Comp Sci, Av Reina Mercedes S-N, Seville 41012, Spain
关键词
Anomaly detection; Novelty detection; Deep learning; Normalizing flow; Unsupervised learning;
D O I
10.1016/j.engappai.2024.109088
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual anomaly detection plays a crucial role in manufacturing to ensure product quality by identifying image patterns that deviate from the expected ones. Existing methods that rely on distribution estimation struggle with the complexity of real-world images, resulting in complex and inefficient procedures. This study leverages normalizing flow techniques to address the cold start anomaly detection problem, where no prior examples of anomalies are available during the training phase. In such scenarios, models must learn exclusively from defect-free images and still accurately identify anomalies. We propose a novel unsupervised multi-scale and multi-semantic normalizing flow model, enhanced with an ensemble of neural networks, to detect anomalies based on their feature distributions. Our model estimates the likelihood of non-defective features, identifying anomalies as out-of-distribution values. Extensive experiments on three state-of-the-art anomaly detection datasets demonstrate that our proposal achieves superior AUROC performance and improves computational efficiency compared to existing approaches. Furthermore, we validate the robustness and adaptability of our proposal through low-shot training experiments using only 20% of available training data, highlighting its potential as an efficient solution for cold start anomaly detection.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] MAD: Multi-Scale Anomaly Detection in Link Streams
    Bautista, Esteban
    Brisson, Laurent
    Bothorel, Cecile
    Smits, Gregory
    PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, : 38 - 46
  • [32] Multi-Scale Anomaly Detection in Complex Dynamic Networks
    Mahyari, Arash Golibagh
    Aviyente, Selin
    2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 603 - 606
  • [33] Multi-Scale Ensemble Learning for Thermal Image Enhancement
    Ban, Yuseok
    Lee, Kyungjae
    APPLIED SCIENCES-BASEL, 2021, 11 (06):
  • [34] Unsupervised anomaly detection in images using attentional normalizing flows
    Wu, Xingzhen
    Mao, Guojun
    Xing, Shuli
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [35] Multi-Scale Dynamic Graph Learning for Time Series Anomaly Detection (Student Abstract)
    Jin, Yixuan
    Wei, Yutao
    Cheng, Zhangtao
    Tai, Wenxin
    Xiao, Chunjing
    Zhong, Ting
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23523 - 23524
  • [36] Multi-Scale Patch-Based Representation Learning for Image Anomaly Detection and Segmentation
    Tsai, Chin-Chia
    Wu, Tsung-Hsuan
    Lai, Shang-Hong
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 3065 - 3073
  • [37] DDANF: Deep denoising autoencoder normalizing flow for unsupervised multivariate time series anomaly detection
    Zhao, Xigang
    Liu, Peng
    Mahmoudi, Said
    Garg, Sahil
    Kaddoum, Georges
    Hassan, Mohammad Mehedi
    ALEXANDRIA ENGINEERING JOURNAL, 2024, 108 : 436 - 444
  • [38] Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented View
    Duan, Jingcan
    Wang, Siwei
    Zhang, Pei
    Zhu, En
    Hu, Jingtao
    Jin, Hu
    Liu, Yue
    Dong, Zhibin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7459 - 7467
  • [39] Sequential Ensemble Method for Unsupervised Anomaly Detection
    Huy Van Nguyen
    Trung Thanh Nguyen
    Quang Uy Nguyen
    2017 9TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (KSE 2017), 2017, : 71 - 76
  • [40] DELR: A double-level ensemble learning method for unsupervised anomaly detection
    Zhang, Jia
    Li, Zhiyong
    Nai, Ke
    Gu, Yu
    Sallam, Ahmed
    KNOWLEDGE-BASED SYSTEMS, 2019, 181