DGTAD: decomposition GAN-based transformer for anomaly detection in multivariate time series data

被引:2
作者
Chen, Zixin [1 ]
Yu, Jiong [1 ,2 ]
Tan, Qiyin [1 ]
Li, Shu [2 ]
Du, XuSheng [2 ]
机构
[1] Xinjiang Univ, Sch Software, Urumqi 830091, Peoples R China
[2] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Transformer; GAN; Multivariate time series; Unsupervised learning; NETWORKS;
D O I
10.1007/s10489-024-05693-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advancement of the computer and information industry has led to the emergence of new demands for multivariate time series anomaly detection (MTSAD) models, namely, the necessity for unsupervised anomaly detection that is both efficient and accurate. However, long-term time series data typically encompass a multitude of intricate temporal pattern variations and noise. Consequently, accurately capturing anomalous patterns within such data and establishing precise and rapid anomaly detection models pose challenging problems. In this paper, we propose a decomposition GAN-based transformer for anomaly detection (DGTAD) in multivariate time series data. Specifically, DGTAD integrates a time series decomposition structure into the original transformer model, further decomposing the extracted global features into deep trend information and seasonal information. On this basis, we improve the attention mechanism, which uses decomposed time-dependent features to change the traditional focus of the transformer, enabling the model to reconstruct anomalies of different types in a targeted manner. This makes it difficult for anomalous data to adapt to these changes, thereby amplifying the anomalous features. Finally, by combining the GAN structure and using multiple generators from different perspectives, we alleviate the mode collapse issue, thereby enhancing the model's generalizability. DGTAD has been validated on nine benchmark datasets, demonstrating significant performance improvements and thus proving its effectiveness in unsupervised anomaly detection.
引用
收藏
页码:13038 / 13056
页数:19
相关论文
共 45 条
  • [1] Unsupervised real-time anomaly detection for streaming data
    Ahmad, Subutai
    Lavin, Alexander
    Purdy, Scott
    Agha, Zuha
    [J]. NEUROCOMPUTING, 2017, 262 : 134 - 147
  • [2] USAD : UnSupervised Anomaly Detection on Multivariate Time Series
    Audibert, Julien
    Michiardi, Pietro
    Guyard, Frederic
    Marti, Sebastien
    Zuluaga, Maria A.
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3395 - 3404
  • [3] A Review on Outlier/Anomaly Detection in Time Series Data
    Blazquez-Garcia, Ane
    Conde, Angel
    Mori, Usue
    Lozano, Jose A.
    [J]. ACM COMPUTING SURVEYS, 2022, 54 (03)
  • [4] LOF: Identifying density-based local outliers
    Breunig, MM
    Kriegel, HP
    Ng, RT
    Sander, J
    [J]. SIGMOD RECORD, 2000, 29 (02) : 93 - 104
  • [5] Component Decomposition Analysis for Hyperspectral Anomaly Detection
    Chen, Shuhan
    Chang, Chein-, I
    Li, Xiaorun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Multi-DGI: Multi-head Pooling Deep Graph Infomax for Human Activity Recognition
    Chen, Yifan
    Zhu, Haiqi
    Chen, Zhiyuan
    [J]. MOBILE NETWORKS & APPLICATIONS, 2024, 29 (03) : 647 - 658
  • [7] Anomaly detection of defects on concrete structures with the convolutional autoencoder
    Chow, J. K.
    Su, Z.
    Wu, J.
    Tan, P. S.
    Mao, X.
    Wang, Y. H.
    [J]. ADVANCED ENGINEERING INFORMATICS, 2020, 45 (45)
  • [8] Ding Z., 2013, IFAC Proc. Vol, V46, P12, DOI [DOI 10.3182/20130902-3-CN-3020.00044, 10.3182/20130902-3-CN-3020.00044]
  • [9] Finder: A novel approach of change point detection for multivariate time series
    Du, Haizhou
    Duan, Ziyi
    [J]. APPLIED INTELLIGENCE, 2022, 52 (03) : 2496 - 2509
  • [10] Graph autoencoder-based unsupervised outlier detection
    Du, Xusheng
    Yu, Jiong
    Chu, Zheng
    Jin, Lina
    Chen, Jiaying
    [J]. INFORMATION SCIENCES, 2022, 608 : 532 - 550