DGTAD: decomposition GAN-based transformer for anomaly detection in multivariate time series data

被引:2
作者
Chen, Zixin [1 ]
Yu, Jiong [1 ,2 ]
Tan, Qiyin [1 ]
Li, Shu [2 ]
Du, XuSheng [2 ]
机构
[1] Xinjiang Univ, Sch Software, Urumqi 830091, Peoples R China
[2] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Transformer; GAN; Multivariate time series; Unsupervised learning; NETWORKS;
D O I
10.1007/s10489-024-05693-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advancement of the computer and information industry has led to the emergence of new demands for multivariate time series anomaly detection (MTSAD) models, namely, the necessity for unsupervised anomaly detection that is both efficient and accurate. However, long-term time series data typically encompass a multitude of intricate temporal pattern variations and noise. Consequently, accurately capturing anomalous patterns within such data and establishing precise and rapid anomaly detection models pose challenging problems. In this paper, we propose a decomposition GAN-based transformer for anomaly detection (DGTAD) in multivariate time series data. Specifically, DGTAD integrates a time series decomposition structure into the original transformer model, further decomposing the extracted global features into deep trend information and seasonal information. On this basis, we improve the attention mechanism, which uses decomposed time-dependent features to change the traditional focus of the transformer, enabling the model to reconstruct anomalies of different types in a targeted manner. This makes it difficult for anomalous data to adapt to these changes, thereby amplifying the anomalous features. Finally, by combining the GAN structure and using multiple generators from different perspectives, we alleviate the mode collapse issue, thereby enhancing the model's generalizability. DGTAD has been validated on nine benchmark datasets, demonstrating significant performance improvements and thus proving its effectiveness in unsupervised anomaly detection.
引用
收藏
页码:13038 / 13056
页数:19
相关论文
共 45 条
[1]   Unsupervised real-time anomaly detection for streaming data [J].
Ahmad, Subutai ;
Lavin, Alexander ;
Purdy, Scott ;
Agha, Zuha .
NEUROCOMPUTING, 2017, 262 :134-147
[2]   USAD : UnSupervised Anomaly Detection on Multivariate Time Series [J].
Audibert, Julien ;
Michiardi, Pietro ;
Guyard, Frederic ;
Marti, Sebastien ;
Zuluaga, Maria A. .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :3395-3404
[3]   A Review on Outlier/Anomaly Detection in Time Series Data [J].
Blazquez-Garcia, Ane ;
Conde, Angel ;
Mori, Usue ;
Lozano, Jose A. .
ACM COMPUTING SURVEYS, 2022, 54 (03)
[4]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[5]   Component Decomposition Analysis for Hyperspectral Anomaly Detection [J].
Chen, Shuhan ;
Chang, Chein-, I ;
Li, Xiaorun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[6]   Multi-DGI: Multi-head Pooling Deep Graph Infomax for Human Activity Recognition [J].
Chen, Yifan ;
Zhu, Haiqi ;
Chen, Zhiyuan .
MOBILE NETWORKS & APPLICATIONS, 2024, 29 (03) :647-658
[7]   Anomaly detection of defects on concrete structures with the convolutional autoencoder [J].
Chow, J. K. ;
Su, Z. ;
Wu, J. ;
Tan, P. S. ;
Mao, X. ;
Wang, Y. H. .
ADVANCED ENGINEERING INFORMATICS, 2020, 45
[8]  
Ding Z., 2013, ICONS, V46, P12, DOI [DOI 10.3182/20130902-3-CN-3020.00044, 10.3182/20130902-3-CN-3020.00044]
[9]   Finder: A novel approach of change point detection for multivariate time series [J].
Du, Haizhou ;
Duan, Ziyi .
APPLIED INTELLIGENCE, 2022, 52 (03) :2496-2509
[10]   Graph autoencoder-based unsupervised outlier detection [J].
Du, Xusheng ;
Yu, Jiong ;
Chu, Zheng ;
Jin, Lina ;
Chen, Jiaying .
INFORMATION SCIENCES, 2022, 608 :532-550