DGTAD: decomposition GAN-based transformer for anomaly detection in multivariate time series data

被引:2
作者
Chen, Zixin [1 ]
Yu, Jiong [1 ,2 ]
Tan, Qiyin [1 ]
Li, Shu [2 ]
Du, XuSheng [2 ]
机构
[1] Xinjiang Univ, Sch Software, Urumqi 830091, Peoples R China
[2] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Transformer; GAN; Multivariate time series; Unsupervised learning; NETWORKS;
D O I
10.1007/s10489-024-05693-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advancement of the computer and information industry has led to the emergence of new demands for multivariate time series anomaly detection (MTSAD) models, namely, the necessity for unsupervised anomaly detection that is both efficient and accurate. However, long-term time series data typically encompass a multitude of intricate temporal pattern variations and noise. Consequently, accurately capturing anomalous patterns within such data and establishing precise and rapid anomaly detection models pose challenging problems. In this paper, we propose a decomposition GAN-based transformer for anomaly detection (DGTAD) in multivariate time series data. Specifically, DGTAD integrates a time series decomposition structure into the original transformer model, further decomposing the extracted global features into deep trend information and seasonal information. On this basis, we improve the attention mechanism, which uses decomposed time-dependent features to change the traditional focus of the transformer, enabling the model to reconstruct anomalies of different types in a targeted manner. This makes it difficult for anomalous data to adapt to these changes, thereby amplifying the anomalous features. Finally, by combining the GAN structure and using multiple generators from different perspectives, we alleviate the mode collapse issue, thereby enhancing the model's generalizability. DGTAD has been validated on nine benchmark datasets, demonstrating significant performance improvements and thus proving its effectiveness in unsupervised anomaly detection.
引用
收藏
页码:13038 / 13056
页数:19
相关论文
共 45 条
  • [31] Multi-source Distributed System Data for AI-Powered Analytics
    Nedelkoski, Sasho
    Bogatinovski, Jasmin
    Mandapati, Ajay Kumar
    Becker, Soeren
    Cardoso, Jorge
    Kao, Odej
    [J]. SERVICE-ORIENTED AND CLOUD COMPUTING (ESOCC 2020), 2020, 12054 : 161 - 176
  • [32] Palleti, 2017, P 3 INT WORKSH CYB P, P25, DOI DOI 10.1145/3055366.3055375
  • [33] Deep Feature Generating Network: A New Method for Intelligent Fault Detection of Mechanical Systems Under Class Imbalance
    Pan, Tongyang
    Chen, Jinglong
    Xie, Jingsong
    Zhou, Zitong
    He, Shuilong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (09) : 6282 - 6293
  • [34] Anomaly Detection in Time Series: A Comprehensive Evaluation
    Schmidl, Sebastian
    Wenig, Phillip
    Papenbrock, Thorsten
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (09): : 1779 - 1797
  • [35] Sen R, 2019, Adv Neural Inf Process Syst, V32
  • [36] Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
    Su, Ya
    Zhao, Youjian
    Niu, Chenhao
    Liu, Rong
    Sun, Wei
    Pei, Dan
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 2828 - 2837
  • [37] TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data
    Tuli, Shreshth
    Casale, Giuliano
    Jennings, Nicholas R.
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (06): : 1201 - 1214
  • [38] Deep Learning for Spatio-Temporal Data Mining: A Survey
    Wang, Senzhang
    Cao, Jiannong
    Yu, Philip S.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (08) : 3681 - 3700
  • [39] Wu HX, 2021, ADV NEUR IN, V34
  • [40] Xu J., 2022, INT C LEARN REPR