Detecting Anomalies in Time Series Using Kernel Density Approaches

被引:1
|
作者
Frehner, Robin [1 ]
Wu, Kesheng [2 ]
Sim, Alexander [2 ]
Kim, Jinoh [3 ]
Stockinger, Kurt [1 ]
机构
[1] Zurich Univ Appl Sci, Sch Engn, CH-8401 Winterthur, Switzerland
[2] Lawrence Berkeley Natl Lab, Berkeley, CA 94720 USA
[3] Texas A&M Univ Commerce, Dept Comp Sci & Informat Syst, Commerce, TX 75428 USA
关键词
Time series anomaly detection; machine learning; neural networks; autoencoder; kernel density estimation;
D O I
10.1109/ACCESS.2024.3371891
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a novel anomaly detection approach tailored for time series data with exclusive reliance on normal events during training. Our key innovation lies in the application of kernel-density estimation (KDE) to scrutinize reconstruction errors, providing an empirically derived probability distribution for normal events post-reconstruction. This non-parametric density estimation technique offers a nuanced understanding of anomaly detection, differentiating it from prevalent threshold-based mechanisms in existing methodologies. In post-training, events are encoded, decoded, and evaluated against the estimated density, providing a comprehensive notion of normality. In addition, we propose a data augmentation strategy involving variational autoencoder-generated events and a smoothing step for enhanced model robustness. The significance of our autoencoder-based approach is evident in its capacity to learn normal representation without prior anomaly knowledge. Through the KDE step on reconstruction errors, our method addresses the versatility of anomalies, departing from assumptions tied to larger reconstruction errors for anomalous events. Our proposed likelihood measure then distinguishes normal from anomalous events, providing a concise yet comprehensive anomaly detection solution. The extensive experimental results support the feasibility of our proposed method, yielding significantly improved classification performance by nearly 10% on the UCR benchmark data.
引用
收藏
页码:33420 / 33439
页数:20
相关论文
共 50 条
  • [1] Detecting Anomalies in Netflow Record Time Series by Using a Kernel Function
    Wagner, Cynthia
    Engel, Thomas
    DEPENDABLE NETWORKS AND SERVICES, 2012, 7279 : 122 - 125
  • [2] Kernel Methods for Detecting the Direction of Time Series
    Peters, Jonas
    Janzing, Dominik
    Gretton, Arthur
    Schoelkopf, Bernhard
    ADVANCES IN DATA ANALYSIS, DATA HANDLING AND BUSINESS INTELLIGENCE, 2010, : 57 - 66
  • [3] Functional Kernel Density Estimation: Point and Fourier Approaches to Time Series Anomaly Detection
    Lindstrom, Michael R.
    Jung, Hyuntae
    Larocque, Denis
    ENTROPY, 2020, 22 (12) : 1 - 15
  • [4] Learning states and rules for detecting anomalies in time series
    Salvador, S
    Chan, P
    APPLIED INTELLIGENCE, 2005, 23 (03) : 241 - 255
  • [5] Learning States and Rules for Detecting Anomalies in Time Series
    Stan Salvador
    Philip Chan
    Applied Intelligence, 2005, 23 : 241 - 255
  • [6] Recursive Kernel Density Estimation for Time Series
    Aboubacar, Amir
    El Machkouri, Mohamed
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (10) : 6378 - 6388
  • [7] Kernel density estimation for time series data
    Harvey, Andrew
    Oryshchenko, Vitaliy
    INTERNATIONAL JOURNAL OF FORECASTING, 2012, 28 (01) : 3 - 14
  • [8] Detecting Anomalies from Streaming Time Series using Matrix Profile and Shapelets Learning
    Alshaer, Mohammad
    Garcia-Rodriguez, Sandra
    Gouy-Pailler, Cedric
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 376 - 383
  • [9] Detecting Multivariate Time Series Anomalies With Cascade Decomposition Consistency
    Li, Ruoheng
    Liu, Zhongyao
    Zhu, Xi
    Li, Lin
    Cao, Xianbin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [10] Detecting Multivariate Time Series Anomalies with Zero Known Label
    Zhou, Qihang
    Chen, Jiming
    Liu, Haoyu
    He, Shibo
    Meng, Wenchao
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4963 - 4971