adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection

被引:71
|
作者
Wang, Xuhong [1 ]
Du, Ying [1 ]
Lin, Shijie [2 ]
Cui, Ping [1 ]
Shen, Yuntian [3 ]
Yang, Yupu [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[2] Wuhan Univ, Wuhan, Peoples R China
[3] Univ Calif Davis, Davis, CA 95616 USA
基金
中国国家自然科学基金;
关键词
Anomaly detection; Outlier detection; Novelty detection; Deep generative model; Variational autoencoder; PRINCIPAL COMPONENT ANALYSIS;
D O I
10.1016/j.knosys.2019.105187
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Moreover, deep generative models have the risk of overfitting training samples, which has disastrous effects on anomaly detection performance. To solve the above two problems, we propose a self-adversarial variational autoencoder (adVAE) with a Gaussian anomaly prior assumption. We assume that both the anomalous and the normal prior distribution are Gaussian and have overlaps in the latent space. Therefore, a Gaussian transformer net T is trained to synthesize anomalous but near-normal latent variables. Keeping the original training objective of a variational autoencoder, a generator G tries to distinguish between the normal latent variables encoded by E and the anomalous latent variables synthesized by T, and the encoder E is trained to discriminate whether the output of G is real. These new objectives we added not only give both G and E the ability to discriminate, but also become an additional regularization mechanism to prevent overfitting. Compared with other competitive methods, the proposed model achieves significant improvements in extensive experiments. The employed datasets and our model are available in a Github repository. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Self-adversarial variational autoencoder with spectral residual for time series anomaly detection
    Liu, Yunxiao
    Lin, Youfang
    Xiao, QinFeng
    Hu, Ganghui
    Wang, Jing
    NEUROCOMPUTING, 2021, 458 (458) : 349 - 363
  • [2] UNSUPERVISED ANOMALY DETECTION USING VARIATIONAL AUTOENCODER WITH GAUSSIAN RANDOM FIELD PRIOR
    Gangloff, Hugo
    Pham, Minh-Tan
    Courtrai, Luc
    Lefevre, Sebastien
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1620 - 1624
  • [3] ACVAE: A novel self-adversarial variational auto-encoder combined with contrast learning for time series anomaly detection
    Zhang, Xiaoxia
    Shi, Shang
    Sun, Haichao
    Chen, Degang
    Wang, Guoyin
    Wu, Kesheng
    NEURAL NETWORKS, 2024, 171 : 383 - 395
  • [4] Adversarial autoencoder for hyperspectral anomaly detection
    Du Q.
    Xie W.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (07): : 1105 - 1114
  • [5] CONTINUAL LEARNING FOR ANOMALY DETECTION WITH VARIATIONAL AUTOENCODER
    Wiewel, Felix
    Yang, Bin
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3837 - 3841
  • [6] Video anomaly detection and localization via Gaussian Mixture Fully Convolutional Variational Autoencoder
    Fan, Yaxiang
    Wen, Gongjian
    Li, Deren
    Qiu, Shaohua
    Levine, Martin D.
    Xiao, Fei
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 195
  • [7] Adversarial Anomaly Detection using Gaussian Priors and Nonlinear Anomaly Scores
    Lueer, Fiete
    Weber, Tobias
    Dolgich, Maxim
    Boehm, Christian
    2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, : 550 - 559
  • [8] Variational Autoencoder for Anomaly Detection in Event Data in Online Process Mining
    Krajsic, Philippe
    Franczyk, Bogdan
    PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS (ICEIS 2021), VOL 1, 2021, : 567 - 574
  • [9] Anomaly detection with a variational autoencoder for Arabic mispronunciation detection
    Lounis M.
    Dendani B.
    Bahi H.
    International Journal of Speech Technology, 2024, 27 (02) : 413 - 424
  • [10] Video anomaly detection and localization via multivariate gaussian fully convolution adversarial autoencoder
    Li, Nanjun
    Chang, Faliang
    NEUROCOMPUTING, 2019, 369 : 92 - 105