Anomaly Detection in Streaming Nonstationary Temporal Data

被引:36
|
作者
Talagala, Priyanga Dilini [1 ,2 ]
Hyndman, Rob J. [1 ,2 ]
Smith-Miles, Kate [2 ,3 ]
Kandanaarachchi, Sevvandi [1 ,2 ]
Munoz, Mario A. [2 ,3 ]
机构
[1] Monash Univ, Dept Econometr & Business Stat, Clayton, Vic 3800, Australia
[2] ARC Ctr Excellence Math & Stat Frontiers ACEMS, Parkville, Vic, Australia
[3] Univ Melbourne, Sch Math & Stat, Parkville, Vic, Australia
基金
澳大利亚研究理事会;
关键词
Concept drift; Extreme value theory; Feature-based time series analysis; Kernel-based density estimation; Multivariate time series; Outlier detection; WIRELESS SENSOR NETWORKS; OUTLIER DETECTION; NOVELTY DETECTION; TIME-SERIES; STATISTICS; MODELS;
D O I
10.1080/10618600.2019.1617160
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article proposes a framework that provides early detection of anomalous series within a large collection of nonstationary streaming time-series data. We define an anomaly as an observation, that is, very unlikely given the recent distribution of a given system. The proposed framework first calculates a boundary for the system's typical behavior using extreme value theory. Then a sliding window is used to test for anomalous series within a newly arrived collection of series. The model uses time series features as inputs, and a density-based comparison to detect any significant changes in the distribution of the features. Using various synthetic and real world datasets, we demonstrate the wide applicability and usefulness of our proposed framework. We show that the proposed algorithm can work well in the presence of noisy nonstationarity data within multiple classes of time series. This framework is implemented in the open source R package oddstream. R code and data are available in the online .
引用
收藏
页码:13 / 27
页数:15
相关论文
共 50 条
  • [1] ADVERSARIAL ANOMALY DETECTION FOR MARKED SPATIO-TEMPORAL STREAMING DATA
    Zhu, Shixiang
    Yuchi, Henry Shaowu
    Xie, Yao
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8921 - 8925
  • [2] Autonomous anomaly detection for streaming data
    Basheer, Muhammad Yunus Iqbal
    Ali, Azliza Mohd
    Hamid, Nurzeatul Hamimah Abdul
    Ariffin, Muhammad Azizi Mohd
    Osman, Rozianawaty
    Nordin, Sharifalillah
    Gu, Xiaowei
    KNOWLEDGE-BASED SYSTEMS, 2024, 284
  • [3] Anomaly pattern detection for streaming data
    Kim, Taegong
    Park, Cheong Hee
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 149
  • [4] Weakly Supervised Anomaly Detection for Streaming Data
    Zhang, Wei
    Challis, Chris
    23RD IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2021), 2021, : 31 - 34
  • [5] Evolving anomaly detection for network streaming data
    Wang Xiaolan
    Ahmed, Md Manjur
    Husen, Mohd Nizam
    Qian, Zhao
    Belhaouari, Samir Brahim
    INFORMATION SCIENCES, 2022, 608 : 757 - 777
  • [6] Anomaly detection in streaming data: A comparison and evaluation study
    Vazquez, Felix Iglesias
    Hartl, Alexander
    Zseby, Tanja
    Zimek, Arthur
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 233
  • [7] Integrated Clustering and Anomaly Detection (INCAD) for Streaming Data
    Guggilam, Sreelekha
    Zaidi, Syed Mohammed Arshad
    Chandola, Varun
    Patra, Abani K.
    COMPUTATIONAL SCIENCE - ICCS 2019, PT IV, 2019, 11539 : 45 - 59
  • [8] Anomaly Detection in Resource Constrained Environments With Streaming Data
    Jain, Prarthi
    Jain, Seemandhar
    Zaiane, Osmar R.
    Srivastava, Abhishek
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03): : 649 - 659
  • [9] Correlated Anomaly Detection from Large Streaming Data
    Chen, Zheng
    Yu, Xinli
    Ling, Yuan
    Song, Bo
    Quan, Wei
    Hu, Xiaohua
    Yan, Erjia
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 982 - 992
  • [10] ANOMALY DETECTION AND CLASSIFICATION FOR STREAMING DATA USING PDES
    Abbasi, Bilal
    Calder, Jeff
    Oberman, Adam M.
    SIAM JOURNAL ON APPLIED MATHEMATICS, 2018, 78 (02) : 921 - 941