Hybrid Anomaly Detection via Multihead Dynamic Graph Attention Networks for Multivariate Time Series

被引:20
作者
Zhou, Liwen [1 ]
Zeng, Qingkui [1 ]
Li, Bo [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
关键词
Time series analysis; Correlation; Anomaly detection; Sensors; Feature extraction; Deep learning; Generative adversarial networks; Multivariate time series; graph attention network; anomaly detection; deep generative model; gated recurrent unit;
D O I
10.1109/ACCESS.2022.3167640
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the real world, a large number of multivariate time series data are generated by Internet of Things systems, which are composed of many connected sensing devices. Therefore, it is impractical to consider only a single univariate time series for decision-making. High-dimensional time series decrease the performance of traditional anomaly detection methods. Moreover, many previously developed methods capture temporal correlations instead of spatial correlations. Therefore, it is necessary to learn the temporal and spatial correlations between different time series and timestamps. In this paper, to achieve improved anomaly detection performance for multivariate time series, we propose a novel architecture based on a graph attention network (GAT) with multihead dynamic attention (MDA). This framework simultaneously learns the dependencies between sensors in both the temporal and spatial dimensions. To tackle the overfitting problem in autoencoder (AE)-based methods, we propose a hybrid approach that combines a novel generative adversarial network (GAN) architecture as a reconstruction model with a multilayer perceptron (MLP) as a prediction-based model to detect anomalies together. The detection framework proposed in this paper is called the HAD-multihead dynamic GAT (MDGAT). Extensive experiments on different public benchmarks demonstrate the superior performance of HAD-MDGAT over state-of-the-art methods.
引用
收藏
页码:40967 / 40978
页数:12
相关论文
共 42 条
  • [1] DAICS: A Deep Learning Solution for Anomaly Detection in Industrial Control Systems
    Abdelaty, Maged
    Doriguzzi-Corin, Roberto
    Siracusa, Domenico
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2022, 10 (02) : 1117 - 1129
  • [2] Practical Approach to Asynchronous Multivariate Time Series Anomaly Detection and Localization
    Abdulaal, Ahmed
    Liu, Zhuanghua
    Lancewicki, Tomer
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 2485 - 2494
  • [3] Aggarwal CC, 2014, CH CRC DATA MIN KNOW, P1
  • [4] Angiulli F., 2002, Principles of Data Mining and Knowledge Discovery. 6th European Conference, PKDD 2002. Proceedings (Lecture Notes in Artificial Intelligence Vol.2431), P15
  • [5] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [6] USAD : UnSupervised Anomaly Detection on Multivariate Time Series
    Audibert, Julien
    Michiardi, Pietro
    Guyard, Frederic
    Marti, Sebastien
    Zuluaga, Maria A.
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3395 - 3404
  • [7] Barbariol T., 2022, Control Charts and Machine Learning for Anomaly Detection in Manufacturing, P149, DOI [10.1007/978-3-030-83819-5_7, DOI 10.1007/978-3-030-83819-57]
  • [8] Real time detection of acoustic anomalies in industrial processes using sequential autoencoders
    Bayram, Baris
    Duman, Taha Berkay
    Ince, Gokhan
    [J]. EXPERT SYSTEMS, 2021, 38 (01)
  • [9] A Review on Outlier/Anomaly Detection in Time Series Data
    Blazquez-Garcia, Ane
    Conde, Angel
    Mori, Usue
    Lozano, Jose A.
    [J]. ACM COMPUTING SURVEYS, 2022, 54 (03)
  • [10] Collective Anomaly Detection Based on Long Short-Term Memory Recurrent Neural Networks
    Bontemps, Loic
    Van Loi Cao
    McDermott, James
    Nhien-An Le-Khac
    [J]. FUTURE DATA AND SECURITY ENGINEERING, FDSE 2016, 2016, 10018 : 141 - 152