Multivariate Time-Series Anomaly Detection Based on Dynamic Graph Neural Networks and Self-Distillation in Industrial Internet of Things

被引:0
作者
Zhao, Mengmeng [1 ,2 ,3 ]
Peng, Haipeng [1 ,2 ]
Li, Lixiang [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, Informat Secur Ctr, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Natl Engn Lab Disaster Backup & Recovery, Beijing 100876, Peoples R China
[3] Zaozhuang Univ, Dept Informat Sci & Engn, Zaozhuang 277160, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; graph neural networks (GNNs); Industrial Internet of Things (IIoT); multivariate time series; self-distillation;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time-series anomaly detection is critical to securing the Industrial Internet of Things (IIoT). Although numerous deep learning-based methods have been proposed, these methods fail to consider the interdependencies between different dimensions of the data and often neglect the dynamic changes in these dependencies. Moreover, these methods utilize only the global features from the last layer of the network for anomaly detection. However, local features can capture subtle variations in the data, which are crucial for accurately detecting anomalies. To alleviate these problems, this article proposes a novel framework for detecting time-series anomalies, including four parts, namely, the graph structure learning module, the dynamic graph module, the anomaly scoring module, and the self-distillation. The graph structure learning module generates different graph structures based on the inputs, which will be used in the dynamic graph module. The dynamic graph module employs dynamic graph neural networks to capture the complex relationships within time series from both temporal and spatial dimensions. The anomaly scoring module obtains anomaly scores from predictions and observed values, and the model makes anomaly judgments based on these scores. Additionally, self-distillation enhances model performance by utilizing mutual learning between the teacher and student models, thereby integrating local and global information for better anomaly detection. We carry out a series of experiments on IIoT datasets, which verify the performance of the framework. The experimental results of the proposed method outperform other methods, demonstrating the advantage of our framework.
引用
收藏
页码:12181 / 12192
页数:12
相关论文
共 57 条
[1]  
Aggarwal C.C., 2017, Outlier Analysis
[2]  
Angiulli F., 2002, Principles of Data Mining and Knowledge Discovery. 6th European Conference, PKDD 2002. Proceedings (Lecture Notes in Artificial Intelligence Vol.2431), P15
[3]   USAD : UnSupervised Anomaly Detection on Multivariate Time Series [J].
Audibert, Julien ;
Michiardi, Pietro ;
Guyard, Frederic ;
Marti, Sebastien ;
Zuluaga, Maria A. .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :3395-3404
[4]  
Bin Z, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4433
[5]   SAND: Streaming Subsequence Anomaly Detection [J].
Boniol, Paul ;
Paparrizos, John ;
Palpanas, Themis ;
Franklin, Michael J. .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2021, 14 (10) :1717-1729
[6]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[7]   Learning Graph Structures With Transformer for Multivariate Time-Series Anomaly Detection in IoT [J].
Chen, Zekai ;
Chen, Dingshuo ;
Zhang, Xiao ;
Yuan, Zixuan ;
Cheng, Xiuzhen .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) :9179-9189
[8]   Anomaly Detection for IoT Time-Series Data: A Survey [J].
Cook, Andrew A. ;
Misirli, Goksel ;
Fan, Zhong .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6481-6494
[9]   A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder [J].
Park, Daehyung ;
Hoshi, Yuuna ;
Kemp, Charles C. .
IEEE Robotics and Automation Letters, 2018, 3 (03) :1544-1551
[10]  
Dai EY, 2022, Arxiv, DOI arXiv:2202.07857