Detecting Anomalies in Time Series Using Kernel Density Approaches

被引:1
作者
Frehner, Robin [1 ]
Wu, Kesheng [2 ]
Sim, Alexander [2 ]
Kim, Jinoh [3 ]
Stockinger, Kurt [1 ]
机构
[1] Zurich Univ Appl Sci, Sch Engn, CH-8401 Winterthur, Switzerland
[2] Lawrence Berkeley Natl Lab, Berkeley, CA 94720 USA
[3] Texas A&M Univ Commerce, Dept Comp Sci & Informat Syst, Commerce, TX 75428 USA
关键词
Time series anomaly detection; machine learning; neural networks; autoencoder; kernel density estimation;
D O I
10.1109/ACCESS.2024.3371891
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing step for enhanced model robustness. The significance of our autoencoder-based approach is evident in its capacity to learn normal representation without prior anomaly knowledge. Through the KDE step on reconstruction errors, our method addresses the versatility of anomalies, departing from assumptions tied to larger reconstruction errors for anomalous events. Our proposed likelihood measure then distinguishes normal from anomalous events, providing a concise yet comprehensive anomaly detection solution. The extensive experimental results support the feasibility of our proposed method, yielding significantly improved classification performance by nearly 10% on the UCR benchmark data.
引用
收藏
页码:33420 / 33439
页数:20
相关论文
共 50 条
  • [31] NONPARAMETRIC SALIENCY DETECTION USING KERNEL DENSITY ESTIMATION
    Liu, Zhi
    Xue, Yinzhu
    Shen, Liquan
    Zhang, Zhaoyang
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 253 - 256
  • [32] Nonlinear process fault detection and identification using kernel PCA and kernel density estimation
    Samuel, Raphael Tari
    Cao, Yi
    SYSTEMS SCIENCE & CONTROL ENGINEERING, 2016, 4 (01): : 165 - 174
  • [33] Time Series Classification for Detecting Fault Location in a DC Microgrid
    Ojetola, Samuel T.
    Reno, Matthew J.
    2023 IEEE PES GRID EDGE TECHNOLOGIES CONFERENCE & EXPOSITION, GRID EDGE, 2023,
  • [34] Time series forecasting for density of wood growth ring using ARIMA and neural networks
    Li, Ming-Bao
    Zhang, Jia-Wei
    Zheng, Shi-Qiang
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 2816 - 2820
  • [35] Indoor environment data time-series reconstruction using autoencoder neural networks
    Liguori, Antonio
    Markovic, Romana
    Dam, Thi Thu Ha
    Frisch, Jerome
    van Treeck, Christoph
    Causone, Francesco
    BUILDING AND ENVIRONMENT, 2021, 191
  • [36] Detecting and Diagnosing Anomalies in Cellular Networks using Random Neural Networks
    Casas, Pedro
    D'Alconzo, Alessandro
    Fiadino, Pierdomenico
    Callegari, Christian
    2016 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING CONFERENCE (IWCMC), 2016, : 351 - 356
  • [37] Detecting anomalous patterns in time-series data using sparse hierarchically parameterized transition matrices
    Michael W. Milo
    Michael J. Roan
    Pattern Analysis and Applications, 2017, 20 : 1029 - 1043
  • [38] A Framework for Detecting System Performance Anomalies Using Tracing Data Analysis
    Kohyarnejadfard, Iman
    Aloise, Daniel
    Dagenais, Michel R.
    Shakeri, Mahsa
    ENTROPY, 2021, 23 (08)
  • [39] DETECTING ANOMALIES IN PROGRAMMABLE LOGIC CONTROLLERS USING UNSUPERVISED MACHINE LEARNING
    Chan, Chun-Fai
    Chow, Kam-Pui
    Mak, Cesar
    Chan, Raymond
    ADVANCES IN DIGITAL FORENSICS XV, 2019, 569 : 119 - 130
  • [40] Comparing Time Series Prediction Approaches for Telecom Analysis
    Pinho, Andre
    Costa, Rogerio
    Silva, Helena
    Furtado, Pedro
    THEORY AND APPLICATIONS OF TIME SERIES ANALYSIS, 2019, : 331 - 345