adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection

被引:71
|
作者
Wang, Xuhong [1 ]
Du, Ying [1 ]
Lin, Shijie [2 ]
Cui, Ping [1 ]
Shen, Yuntian [3 ]
Yang, Yupu [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[2] Wuhan Univ, Wuhan, Peoples R China
[3] Univ Calif Davis, Davis, CA 95616 USA
基金
中国国家自然科学基金;
关键词
Anomaly detection; Outlier detection; Novelty detection; Deep generative model; Variational autoencoder; PRINCIPAL COMPONENT ANALYSIS;
D O I
10.1016/j.knosys.2019.105187
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Moreover, deep generative models have the risk of overfitting training samples, which has disastrous effects on anomaly detection performance. To solve the above two problems, we propose a self-adversarial variational autoencoder (adVAE) with a Gaussian anomaly prior assumption. We assume that both the anomalous and the normal prior distribution are Gaussian and have overlaps in the latent space. Therefore, a Gaussian transformer net T is trained to synthesize anomalous but near-normal latent variables. Keeping the original training objective of a variational autoencoder, a generator G tries to distinguish between the normal latent variables encoded by E and the anomalous latent variables synthesized by T, and the encoder E is trained to discriminate whether the output of G is real. These new objectives we added not only give both G and E the ability to discriminate, but also become an additional regularization mechanism to prevent overfitting. Compared with other competitive methods, the proposed model achieves significant improvements in extensive experiments. The employed datasets and our model are available in a Github repository. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Interpreting rate-distortion of variational autoencoder and using model uncertainty for anomaly detection
    Park, Seonho
    Adosoglou, George
    Pardalos, Panos M.
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2022, 90 (7-9) : 735 - 752
  • [42] ANOMALY DETECTION IN SQUARE BUTT JOINT BY FRICTION STIR WELDING USING VARIATIONAL AUTOENCODER
    Oda, Kazuya
    Suwa, Haruhiko
    Murakami, Koji
    PROCEEDINGS OF 2024 INTERNATIONAL SYMPOSIUM ON FLEXIBLE AUTOMATION, ISFA 2024, 2024,
  • [43] Helicopter transmission system anomaly detection in variable flight regimes with decoupling variational autoencoder
    Wu, Jingyao
    Hu, Chenye
    Sun, Chuang
    Zhao, Zhibin
    Yan, Ruqiang
    Chen, Xuefeng
    AEROSPACE SCIENCE AND TECHNOLOGY, 2024, 144
  • [44] Autoencoder for Network Anomaly Detection
    Park, Won
    Ferland, Nicolas
    Sun, Wenting
    2022 IEEE INTERNATIONAL SYMPOSIUM ON MEASUREMENTS & NETWORKING (M&N 2022), 2022,
  • [45] Interpreting rate-distortion of variational autoencoder and using model uncertainty for anomaly detection
    Seonho Park
    George Adosoglou
    Panos M. Pardalos
    Annals of Mathematics and Artificial Intelligence, 2022, 90 : 735 - 752
  • [46] Unsupervised Anomaly Video Detection via a Double-Flow ConvLSTM Variational Autoencoder
    Wang, Lin
    Tan, Haishu
    Zhou, Fuqiang
    Zuo, Wangxia
    Sun, Pengfei
    IEEE ACCESS, 2022, 10 : 44278 - 44289
  • [47] Autoencoder-Like Knowledge Distillation Network for Anomaly Detection
    Xu, Caie
    Wang, Bingyan
    Ni, Dandan
    Gan, Jin
    Wu, Mingyang
    Zhou, Wujie
    IEEE ACCESS, 2023, 11 : 100622 - 100631
  • [48] IoT Anomaly Detection Based on Autoencoder and Bayesian Gaussian Mixture Model
    Hou, Yunyun
    He, Ruiyu
    Dong, Jie
    Yang, Yangrui
    Ma, Wei
    ELECTRONICS, 2022, 11 (20)
  • [49] Anomaly Detection with Dual Adversarial Training
    Liu, Shuo
    Xu, Liwen
    21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021, 2021, : 466 - 473
  • [50] A Robust Anomaly Detection Model for Pumps Based on the Spectral Residual With Self-Attention Variational Autoencoder
    Xie, Tianming
    Xu, Qifa
    Jiang, Cuixia
    Gao, Zhiwei
    Wang, Xiangxiang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (06) : 9059 - 9069