Towards an Awareness of Time Series Anomaly Detection Models' Adversarial Vulnerability

被引:4
作者
Tariq, Shahroz [1 ]
Le, Binh M. [2 ]
Woo, Simon S. [3 ]
机构
[1] Data61 CSIRO, Sydney, NSW, Australia
[2] Sungkyunkwan Univ, Coll Comp & Informat, Seoul, South Korea
[3] Sungkyunkwan Univ, Dept Artificial Intelligence, Seoul, South Korea
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022 | 2022年
基金
新加坡国家研究基金会;
关键词
Adversarial Attack; Anomaly Detection; Time Series; Classification;
D O I
10.1145/3511808.3557073
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time series anomaly detection is extensively studied in statistics, economics, and computer science. Over the years, numerous methods have been proposed for time series anomaly detection using deep learning-based methods. Many of these methods demonstrate state-of-the-art performance on benchmark datasets, giving the false impression that these systems are robust and deployable in many practical and industrial real-world scenarios. In this paper, we demonstrate that the performance of state-of-the-art anomaly detection methods is degraded substantially by adding only small adversarial perturbations to the sensor data. We use different scoring metrics such as prediction errors, anomaly, and classification scores over several public and private datasets ranging from aerospace applications, server machines, to cyber-physical systems in power plants. Under well-known adversarial attacks from Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD) methods, we demonstrate that state-of-the-art deep neural networks (DNNs) and graph neural networks (GNNs) methods, which claim to be robust against anomalies and have been possibly integrated in real-life systems, have their performance drop to as low as 0%. To the best of our understanding, we demonstrate, for the first time, the vulnerabilities of anomaly detection systems against adversarial attacks. The overarching goal of this research is to raise awareness towards the adversarial vulnerabilities of time series anomaly detectors.
引用
收藏
页码:3534 / 3544
页数:11
相关论文
共 50 条
[21]   Towards Efficient Deep Autoencoders for Multivariate Time Series Anomaly Detection [J].
Pietron, Marcin ;
Zurek, Dominik ;
Faber, Kamil ;
Corizzo, Roberto .
COMPUTATIONAL SCIENCE, ICCS 2024, PT III, 2024, 14834 :461-469
[22]   A SURVEY OF RESEARCH ON ANOMALY DETECTION FOR TIME SERIES [J].
Wu, Hu-Sheng .
2016 13TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2016, :426-431
[23]   Variable-wise generative adversarial transformer in multivariate time series anomaly detection [J].
Yang, Xuekang ;
Li, Hui ;
Feng, Xingyu ;
Jin, Zixiong .
APPLIED INTELLIGENCE, 2023, 53 (23) :28745-28767
[24]   Variable-wise generative adversarial transformer in multivariate time series anomaly detection [J].
Xuekang Yang ;
Hui Li ;
Xingyu Feng ;
Zixiong Jin .
Applied Intelligence, 2023, 53 :28745-28767
[25]   Time Series Anomaly Detection Based on GAN [J].
Sun, Yong ;
Yu, Wenbo ;
Chen, Yuting ;
Kadam, Aishwarya .
2019 SIXTH INTERNATIONAL CONFERENCE ON SOCIAL NETWORKS ANALYSIS, MANAGEMENT AND SECURITY (SNAMS), 2019, :375-382
[26]   Unsupervised Anomaly Detection Approach Based on Adversarial Memory Autoencoders for Multivariate Time Series [J].
Zhao, Tianzi ;
Jin, Liang ;
Zhou, Xiaofeng ;
Li, Shuai ;
Liu, Shurui ;
Zhu, Jiang .
CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (01) :329-346
[27]   Anomaly Detection for Time Series Data Stream [J].
Wang, Qifan ;
Yan, Bo ;
Su, Hongyi ;
Zheng, Hong .
2021 IEEE 6TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (ICBDA 2021), 2021, :118-122
[28]   Time Series Anomaly Detection with Reconstruction-Based State-Space Models [J].
Wang, Fan ;
Wang, Keli ;
Yao, Boyu .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 :74-86
[29]   Anomaly Scoring for Prediction-Based Anomaly Detection in Time Series [J].
Li, Tianyu ;
Comer, Mary L. ;
Delp, Edward J. ;
Desai, Sundip R. ;
Mathieson, James L. ;
Foster, Richard H. ;
Chan, Moses W. .
2020 IEEE AEROSPACE CONFERENCE (AEROCONF 2020), 2020,
[30]   Multivariate time series anomaly detection: A framework of Hidden Markov Models [J].
Li, Jinbo ;
Pedrycz, Witold ;
Jamal, Iqbal .
APPLIED SOFT COMPUTING, 2017, 60 :229-240