DGTAD: decomposition GAN-based transformer for anomaly detection in multivariate time series data

被引:2
作者
Chen, Zixin [1 ]
Yu, Jiong [1 ,2 ]
Tan, Qiyin [1 ]
Li, Shu [2 ]
Du, XuSheng [2 ]
机构
[1] Xinjiang Univ, Sch Software, Urumqi 830091, Peoples R China
[2] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Transformer; GAN; Multivariate time series; Unsupervised learning; NETWORKS;
D O I
10.1007/s10489-024-05693-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advancement of the computer and information industry has led to the emergence of new demands for multivariate time series anomaly detection (MTSAD) models, namely, the necessity for unsupervised anomaly detection that is both efficient and accurate. However, long-term time series data typically encompass a multitude of intricate temporal pattern variations and noise. Consequently, accurately capturing anomalous patterns within such data and establishing precise and rapid anomaly detection models pose challenging problems. In this paper, we propose a decomposition GAN-based transformer for anomaly detection (DGTAD) in multivariate time series data. Specifically, DGTAD integrates a time series decomposition structure into the original transformer model, further decomposing the extracted global features into deep trend information and seasonal information. On this basis, we improve the attention mechanism, which uses decomposed time-dependent features to change the traditional focus of the transformer, enabling the model to reconstruct anomalies of different types in a targeted manner. This makes it difficult for anomalous data to adapt to these changes, thereby amplifying the anomalous features. Finally, by combining the GAN structure and using multiple generators from different perspectives, we alleviate the mode collapse issue, thereby enhancing the model's generalizability. DGTAD has been validated on nine benchmark datasets, demonstrating significant performance improvements and thus proving its effectiveness in unsupervised anomaly detection.
引用
收藏
页码:13038 / 13056
页数:19
相关论文
共 45 条
[31]   Multi-source Distributed System Data for AI-Powered Analytics [J].
Nedelkoski, Sasho ;
Bogatinovski, Jasmin ;
Mandapati, Ajay Kumar ;
Becker, Soeren ;
Cardoso, Jorge ;
Kao, Odej .
SERVICE-ORIENTED AND CLOUD COMPUTING (ESOCC 2020), 2020, 12054 :161-176
[32]  
Palleti, 2017, P 3 INT WORKSH CYB P, P25, DOI DOI 10.1145/3055366.3055375
[33]   Deep Feature Generating Network: A New Method for Intelligent Fault Detection of Mechanical Systems Under Class Imbalance [J].
Pan, Tongyang ;
Chen, Jinglong ;
Xie, Jingsong ;
Zhou, Zitong ;
He, Shuilong .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (09) :6282-6293
[34]   Anomaly Detection in Time Series: A Comprehensive Evaluation [J].
Schmidl, Sebastian ;
Wenig, Phillip ;
Papenbrock, Thorsten .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (09) :1779-1797
[35]  
Sen R, 2019, ADV NEURAL INF PROCE, V32
[36]   Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network [J].
Su, Ya ;
Zhao, Youjian ;
Niu, Chenhao ;
Liu, Rong ;
Sun, Wei ;
Pei, Dan .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2828-2837
[37]   TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data [J].
Tuli, Shreshth ;
Casale, Giuliano ;
Jennings, Nicholas R. .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (06) :1201-1214
[38]   Deep Learning for Spatio-Temporal Data Mining: A Survey [J].
Wang, Senzhang ;
Cao, Jiannong ;
Yu, Philip S. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (08) :3681-3700
[39]  
Wu HX, 2021, ADV NEUR IN, V34
[40]  
Xu J, 2022, INT C LEARN REPR