MTS-GAT: multivariate time series anomaly detection based on graph attention networks

被引:4
作者
Chen, Ling [1 ]
Mao, Yingchi [2 ]
Zhou, Hongliang [1 ]
Zhang, Benteng [1 ]
Wang, Zicheng [3 ]
Wu, Jie [4 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Jiangsu, Peoples R China
[2] Hohai Univ, Key Lab Water Big Data Technol, Minist Water Resources, Nanjing 211100, Jiangsu, Peoples R China
[3] PowerChina Kunming Engn Corp Ltd, Kunming 650051, Yunnan, Peoples R China
[4] Temple Univ, Ctr Networked Comp, Philadelphia, PA 19122 USA
关键词
multivariate time series; anomaly detection; graph neural networks; attention mechanism;
D O I
10.1504/IJSNET.2023.133812
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Anomaly detection using multivariate time series data from sensors can determine whether the equipment is operating normally. However, anomaly detection suffers from inadequate utilisation of spatio-temporal dependencies and unclear explanations of anomaly causes. To improve the accuracy of anomaly detection and rationalise the causes of anomalies, we propose multivariate time series anomaly detection based on graph attention networks (MTS-GAT). MTS-GAT constructs variable and temporal graphs using embedding vector similarity. The nonlinear dependencies of the variable and temporal dimensions are learned through two parallel graph attention layers. Finally, MTS-GAT jointly optimises the prediction-based and reconstruction-based models. Anomalous variables are localised with the anomaly scores computed after the joint optimisation to enhance the interpretability of anomaly detection. Experimental evaluations prove that MTS-GAT outperforms the best baseline approach, GDN. The F1 scores are improved by 2.73%, 3.39%, and 0.9% on SWaT, WADI, and SMD datasets.
引用
收藏
页码:38 / 49
页数:16
相关论文
共 23 条
[11]   Graph neural network for traffic forecasting: A survey [J].
Jiang, Weiwei ;
Luo, Jiayun .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 207
[12]  
Kingma D.P., 2017, Adam: A method for stochastic optimization
[13]   Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks [J].
Lai, Guokun ;
Chang, Wei-Cheng ;
Yang, Yiming ;
Liu, Hanxiao .
ACM/SIGIR PROCEEDINGS 2018, 2018, :95-104
[14]   MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks [J].
Li, Dan ;
Chen, Dacheng ;
Shi, Lei ;
Jin, Baihong ;
Goh, Jonathan ;
Ng, See-Kiong .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: TEXT AND TIME SERIES, PT IV, 2019, 11730 :703-716
[15]  
Mathur AP, 2016, 2016 INTERNATIONAL WORKSHOP ON CYBER-PHYSICAL SYSTEMS FOR SMART WATER NETWORKS (CYSWATER), P31, DOI 10.1109/CySWater.2016.7469060
[16]   Using LSTM and ARIMA to Simulate and Predict Limestone Price Variations [J].
Mbah, Tawum Juvert ;
Ye, Haiwang ;
Zhang, Jianhua ;
Long, Mei .
MINING METALLURGY & EXPLORATION, 2021, 38 (02) :913-926
[17]   Temporal pattern attention for multivariate time series forecasting [J].
Shih, Shun-Yao ;
Sun, Fan-Keng ;
Lee, Hung-yi .
MACHINE LEARNING, 2019, 108 (8-9) :1421-1441
[18]   Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network [J].
Su, Ya ;
Zhao, Youjian ;
Niu, Chenhao ;
Liu, Rong ;
Sun, Wei ;
Pei, Dan .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2828-2837
[19]  
Taud H., 2018, Geomatic Approaches for Modeling Land Change Scenarios, P451, DOI DOI 10.1007/978-3-319-60801-3_27
[20]   An Attention-Based ConvLSTM Autoencoder with Dynamic Thresholding for Unsupervised Anomaly Detection in Multivariate Time Series [J].
Tayeh, Tareq ;
Aburakhia, Sulaiman ;
Myers, Ryan ;
Shami, Abdallah .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2022, 4 (02) :350-370