Detecting Anomalies in Time Series Using Kernel Density Approaches

被引:1
作者
Frehner, Robin [1 ]
Wu, Kesheng [2 ]
Sim, Alexander [2 ]
Kim, Jinoh [3 ]
Stockinger, Kurt [1 ]
机构
[1] Zurich Univ Appl Sci, Sch Engn, CH-8401 Winterthur, Switzerland
[2] Lawrence Berkeley Natl Lab, Berkeley, CA 94720 USA
[3] Texas A&M Univ Commerce, Dept Comp Sci & Informat Syst, Commerce, TX 75428 USA
关键词
Time series anomaly detection; machine learning; neural networks; autoencoder; kernel density estimation;
D O I
10.1109/ACCESS.2024.3371891
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing step for enhanced model robustness. The significance of our autoencoder-based approach is evident in its capacity to learn normal representation without prior anomaly knowledge. Through the KDE step on reconstruction errors, our method addresses the versatility of anomalies, departing from assumptions tied to larger reconstruction errors for anomalous events. Our proposed likelihood measure then distinguishes normal from anomalous events, providing a concise yet comprehensive anomaly detection solution. The extensive experimental results support the feasibility of our proposed method, yielding significantly improved classification performance by nearly 10% on the UCR benchmark data.
引用
收藏
页码:33420 / 33439
页数:20
相关论文
共 50 条
  • [41] Detecting anomalous patterns in time-series data using sparse hierarchically parameterized transition matrices
    Milo, Michael W.
    Roan, Michael J.
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2017, 20 (04) : 1029 - 1043
  • [42] A deep graph kernel-based time series classification algorithm
    Yu, Mengping
    Huang, Huan
    Hou, Rui
    Ma, Xiaoxuan
    Yuan, Shuai
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (03)
  • [43] Parameter Density Inheritance Using Kernel Density Estimation for Efficient CNN Learning
    Horiuchi, Keisuke
    Kameyama, Keisuke
    [J]. 2018 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY (ISSPIT), 2018, : 308 - 313
  • [44] Novel approaches for online playout delay prediction in VoIP applications using time series models
    Aragao, Jose B., Jr.
    Barreto, Guilherme A.
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2010, 36 (03) : 536 - 544
  • [45] Modelling and prediction of GNSS time series using GBDT, LSTM and SVM machine learning approaches
    Gao, Wenzong
    Li, Zhao
    Chen, Qusen
    Jiang, Weiping
    Feng, Yanming
    [J]. JOURNAL OF GEODESY, 2022, 96 (10)
  • [46] Modelling and prediction of GNSS time series using GBDT, LSTM and SVM machine learning approaches
    Wenzong Gao
    Zhao Li
    Qusen Chen
    Weiping Jiang
    Yanming Feng
    [J]. Journal of Geodesy, 2022, 96
  • [47] EnsPKDE&IncLKDE: a hybrid time series prediction algorithm integrating dynamic ensemble pruning, incremental learning, and kernel density estimation
    Zhu, Gangliang
    Dai, Qun
    [J]. APPLIED INTELLIGENCE, 2021, 51 (02) : 617 - 645
  • [48] TAKDE: Temporal Adaptive Kernel Density Estimator for Real-Time Dynamic Density Estimation
    Wang, Yinsong
    Ding, Yu
    Shahrampour, Shahin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13831 - 13843
  • [49] Modeling of Time Geographical Kernel Density Function under Network Constraints
    Yin, Zhangcai
    Huang, Kuan
    Ying, Shen
    Huang, Wei
    Kang, Ziqiang
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (03)
  • [50] Time-weighted kernel density for gearbox residual life prediction
    Weizhen Zhang
    Jianchao Zeng
    Hui Shi
    Bin Wu
    Guannan Shi
    [J]. Scientific Reports, 15 (1)