adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection

被引:71
|
作者
Wang, Xuhong [1 ]
Du, Ying [1 ]
Lin, Shijie [2 ]
Cui, Ping [1 ]
Shen, Yuntian [3 ]
Yang, Yupu [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[2] Wuhan Univ, Wuhan, Peoples R China
[3] Univ Calif Davis, Davis, CA 95616 USA
基金
中国国家自然科学基金;
关键词
Anomaly detection; Outlier detection; Novelty detection; Deep generative model; Variational autoencoder; PRINCIPAL COMPONENT ANALYSIS;
D O I
10.1016/j.knosys.2019.105187
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Moreover, deep generative models have the risk of overfitting training samples, which has disastrous effects on anomaly detection performance. To solve the above two problems, we propose a self-adversarial variational autoencoder (adVAE) with a Gaussian anomaly prior assumption. We assume that both the anomalous and the normal prior distribution are Gaussian and have overlaps in the latent space. Therefore, a Gaussian transformer net T is trained to synthesize anomalous but near-normal latent variables. Keeping the original training objective of a variational autoencoder, a generator G tries to distinguish between the normal latent variables encoded by E and the anomalous latent variables synthesized by T, and the encoder E is trained to discriminate whether the output of G is real. These new objectives we added not only give both G and E the ability to discriminate, but also become an additional regularization mechanism to prevent overfitting. Compared with other competitive methods, the proposed model achieves significant improvements in extensive experiments. The employed datasets and our model are available in a Github repository. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Multivariate time series anomaly detection with variational autoencoder and spatial-temporal graph network
    Guan, Siwei
    He, Zhiwei
    Ma, Shenhui
    Gao, Mingyu
    COMPUTERS & SECURITY, 2024, 142
  • [32] Variational Autoencoder Anomaly-Detection of Avalanche Deposits in Satellite SAR Imagery
    Sinha, Saumya
    Giffard-Roisin, Sophie
    Karbou, Fatima
    Deschatres, Michael
    Karas, Anna
    Eckert, Nicolas
    Coleou, Cecile
    Monteleoni, Claire
    PROCEEDINGS OF 2020 10TH INTERNATIONAL CONFERENCE ON CLIMATE INFORMATICS (CI2020), 2020, : 113 - 119
  • [33] Evolutionary Adversarial Autoencoder for Unsupervised Anomaly Detection of Industrial Internet of Things
    Zeng, Guo-Qiang
    Yang, Yao-Wei
    Lu, Kang-Di
    Geng, Guang-Gang
    Weng, Jian
    IEEE TRANSACTIONS ON RELIABILITY, 2025,
  • [34] An adversarial contrastive autoencoder for robust multivariate time series anomaly detection
    Yu, Jiahao
    Gao, Xin
    Zhai, Feng
    Li, Baofeng
    Xue, Bing
    Fu, Shiyuan
    Chen, Lingli
    Meng, Zhihang
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 245
  • [35] An Anomaly Detection Method Combining Mutual Information Estimation with Adversarial Autoencoder
    Huo W.-G.
    Wang X.
    Liang R.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2021, 44 (05): : 28 - 34
  • [36] Multi-mode non-Gaussian variational autoencoder network with missing sources for anomaly detection of complex electromechanical equipment
    Luo, Qinyuan
    Chen, Jinglong
    Zi, Yanyang
    Chang, Yuanhong
    Feng, Yong
    ISA TRANSACTIONS, 2023, 134 : 144 - 158
  • [37] Semisupervised anomaly detection of multivariate time series based on a variational autoencoder
    Ningjiang Chen
    Huan Tu
    Xiaoyan Duan
    Liangqing Hu
    Chengxiang Guo
    Applied Intelligence, 2023, 53 : 6074 - 6098
  • [38] VAEAT: Variational AutoeEncoder with adversarial training for multivariate time series anomaly detection
    He, Sheng
    Du, Mingjing
    Jiang, Xiang
    Zhang, Wenbin
    Wang, Congyu
    INFORMATION SCIENCES, 2024, 676
  • [39] Anomaly Detection in Asset Degradation Process Using Variational Autoencoder and Explanations
    Jakubowski, Jakub
    Stanisz, Przemyslaw
    Bobek, Szymon
    Nalepa, Grzegorz J.
    SENSORS, 2022, 22 (01)
  • [40] Semisupervised anomaly detection of multivariate time series based on a variational autoencoder
    Chen, Ningjiang
    Tu, Huan
    Duan, Xiaoyan
    Hu, Liangqing
    Guo, Chengxiang
    APPLIED INTELLIGENCE, 2023, 53 (05) : 6074 - 6098