TimeAutoAD: Autonomous Anomaly Detection With Self-Supervised Contrastive Loss for Multivariate Time Series

被引:23
|
作者
Jiao, Yang [1 ]
Yang, Kai [1 ]
Song, Dongjing [2 ]
Tao, Dacheng [3 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, Shanghai 200092, Peoples R China
[2] Univ Connecticut, Dept Comp Sci, Storrs, CT 06269 USA
[3] JD Explore Acad JD Com, Beijing 100176, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Time series analysis; Pipelines; Optimization; Machine learning; Feature extraction; Training data; Multivariate time series; anomaly detection; Automatic Machine Learning (AutoML); self-supervised learning; contrastive loss; SUPPORT; SEARCH;
D O I
10.1109/TNSE.2022.3148276
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Multivariate time series (MTS) data are becoming increasingly ubiquitous in networked systems, e.g., IoT systems and 5G networks. Anomaly detection in MTS refers to identifying time series which exhibit different behaviors from normal status. Building such a system, however, is challenging due to a few reasons: i) labels for anomaly cases are usually unavailable or very rare; ii) most existing approaches rely on manual model-design and hyperparameter tuning, which may cost a huge amount of labor effort. To this end, we propose an autonomous anomaly detection technique for multivariate time series data (TimeAutoAD) based on a novel self-supervised contrastive loss. Specifically, we first present an automatic anomaly detection pipeline to optimize the model configuration and hyperparameters automatically. Next, we introduce three different strategies to augment the training data for generating pseudo negative time series and employ a self-supervised contrastive loss to distinguish the original time series and the generated time series. In this way, the representation learning capability of TimeAutoAD can be greatly enhanced and the anomaly detection performance can thus be improved. Extensive empirical studies on real-world datasets demonstrate that the proposed TimeAutoAD not only outperforms state-of-the-art anomaly detection approaches but also exhibits robustness when training data are contaminated.
引用
收藏
页码:1604 / 1619
页数:16
相关论文
共 50 条
  • [21] Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation
    Islam, Ashraful
    Lundell, Ben
    Sawhney, Harpreet
    Sinha, Sudipta N.
    Morales, Peter
    Radke, Richard J.
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5613 - 5622
  • [22] Self-Supervised Contrastive Learning for Medical Time Series: A Systematic Review
    Liu, Ziyu
    Alavi, Azadeh
    Li, Minyi
    Zhang, Xiang
    SENSORS, 2023, 23 (09)
  • [23] Self-Supervised Time Series Classification Based on LSTM and Contrastive Transformer
    ZOU Yuanhao
    ZHANG Yufei
    ZHAO Xiaodong
    WuhanUniversityJournalofNaturalSciences, 2022, 27 (06) : 521 - 530
  • [24] Contrastive learning based self-supervised time-series analysis
    Poppelbaum, Johannes
    Chadha, Gavneet Singh
    Schwung, Andreas
    APPLIED SOFT COMPUTING, 2022, 117
  • [25] Self-supervised Classification of Clinical Multivariate Time Series using Time Series Dynamics
    Yehuda, Yakir
    Freedman, Daniel
    Radinsky, Kira
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 5416 - 5427
  • [26] Anomaly Detection for Multivariate Time Series Based on Contrastive Learning and Autoformer
    Shang, Xuwen
    Zhang, Jue
    Jiang, Xingguo
    Luo, Hong
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2614 - 2619
  • [27] An adversarial contrastive autoencoder for robust multivariate time series anomaly detection
    Yu, Jiahao
    Gao, Xin
    Zhai, Feng
    Li, Baofeng
    Xue, Bing
    Fu, Shiyuan
    Chen, Lingli
    Meng, Zhihang
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 245
  • [28] Contrastive Self-Supervised Learning-Based Background Reconstruction for Hyperspectral Anomaly Detection
    Sun, Xiaoming
    Zhang, Yuxiang
    Dong, Yanni
    Du, Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [29] Time Series Anomaly Detection for Smart Grids via Multiple Self-Supervised Tasks Learning
    Zhang, Zhenyu
    Zhao, Lin
    Cai, Dongyang
    Feng, Shuming
    Miao, Jiawei
    Guan, Yirun
    Tao, Haicheng
    Cao, Jie
    2022 IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG), 2022, : 392 - 397
  • [30] TimeCLR: A self-supervised contrastive learning framework for univariate time series representation
    Yang, Xinyu
    Zhang, Zhenguo
    Cui, Rongyi
    KNOWLEDGE-BASED SYSTEMS, 2022, 245