Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things

被引:1
作者
Zhao, Mengmeng [1 ,2 ,3 ]
Peng, Haipeng [1 ,2 ]
Li, Lixiang [1 ,2 ]
Ren, Yeqing [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, Informat Secur Ctr, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Natl Engn Lab Disaster Backup & Recovery, Beijing 100876, Peoples R China
[3] Zaozhuang Univ, Dept Informat Sci & Engn, Zaozhuang 277160, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 02期
基金
中国国家自然科学基金;
关键词
Multivariate time series; anomaly detection; spatial-temporal network; Transformer;
D O I
10.32604/cmc.2024.053765
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the Industrial Internet of Things (IIoT), sensors generate time series data to reflect the working state. When the systems are attacked, timely identification of outliers in time series is critical to ensure security. Although many anomaly detection methods have been proposed, the temporal correlation of the time series over the same sensor and the state (spatial) correlation between different sensors are rarely considered simultaneously in these methods. Owing to the superior capability of Transformer in learning time series features. This paper proposes a time series anomaly detection method based on a spatial-temporal network and an improved Transformer. Additionally, the methods based on graph neural networks typically include a graph structure learning module and an anomaly detection module, which are interdependent. However, in the initial phase of training, since neither of the modules has reached an optimal state, their performance may influence each other. This scenario makes the end-to-end training approach hard to effectively direct the learning trajectory of each module. This interdependence between the modules, coupled with the initial instability, may cause the model to find it hard to find the optimal solution during the training process, resulting in unsatisfactory results. We introduce an adaptive graph structure learning method to obtain the optimal model parameters and graph structure. Experiments on two publicly available datasets demonstrate that the proposed method attains higher anomaly detection results than other methods.
引用
收藏
页码:2815 / 2837
页数:23
相关论文
共 41 条
[1]  
Aggarwal C.C., 2015, Data Mining, P237, DOI DOI 10.1007/978-3-319-14142-8
[2]  
Angiulli F., 2002, Principles of Data Mining and Knowledge Discovery. 6th European Conference, PKDD 2002. Proceedings (Lecture Notes in Artificial Intelligence Vol.2431), P15
[3]   USAD : UnSupervised Anomaly Detection on Multivariate Time Series [J].
Audibert, Julien ;
Michiardi, Pietro ;
Guyard, Frederic ;
Marti, Sebastien ;
Zuluaga, Maria A. .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :3395-3404
[4]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[5]  
Chen W., 2022, P INT C MACH LEARN I, P153
[6]   Learning Graph Structures With Transformer for Multivariate Time-Series Anomaly Detection in IoT [J].
Chen, Zekai ;
Chen, Dingshuo ;
Zhang, Xiao ;
Yuan, Zixuan ;
Cheng, Xiuzhen .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) :9179-9189
[7]   A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder [J].
Park, Daehyung ;
Hoshi, Yuuna ;
Kemp, Charles C. .
IEEE Robotics and Automation Letters, 2018, 3 (03) :1544-1551
[8]   Deep Recurrent Graph Convolutional Architecture for Sensor Fault Detection, Isolation, and Accommodation in Digital Twins [J].
Darvishi, Hossein ;
Ciuonzo, Domenico ;
Rossi, Pierluigi Salvo .
IEEE SENSORS JOURNAL, 2023, 23 (23) :29877-29891
[9]  
Deng AL, 2021, AAAI CONF ARTIF INTE, V35, P4027
[10]  
Dosovitskiy A, 2021, Arxiv, DOI [arXiv:2010.11929, DOI 10.48550/ARXIV.2010.11929]