Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer

被引:5
作者
Baidya, Ranjai [1 ]
Jeong, Heon [2 ]
机构
[1] Kpro Syst, 673-1 Dogok Ri, Namyangju Si 12270, Gyeonggi Do, South Korea
[2] Chodang Univ, Dept Fire Serv Adm, 80 Muanro, Muangun 58530, Jeollanam Do, South Korea
基金
新加坡国家研究基金会;
关键词
time series data; anomaly detection; attention mechanism; transformer; normalization;
D O I
10.3390/s23229272
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Anomalies are infrequent in nature, but detecting these anomalies could be crucial for the proper functioning of any system. The rarity of anomalies could be a challenge for their detection as detection models are required to depend on the relations of the datapoints with their adjacent datapoints. In this work, we use the rarity of anomalies to detect them. For this, we introduce the reversible instance normalized anomaly transformer (RINAT). Rooted in the foundational principles of the anomaly transformer, RINAT incorporates both prior and series associations for each time point. The prior association uses a learnable Gaussian kernel to ensure a thorough understanding of the adjacent concentration inductive bias. In contrast, the series association method uses self-attention techniques to specifically focus on the original raw data. Furthermore, because anomalies are rare in nature, we utilize normalized data to identify series associations and employ non-normalized data to uncover prior associations. This approach enhances the modelled series associations and, consequently, improves the association discrepancies.
引用
收藏
页数:15
相关论文
共 51 条
  • [1] Practical Approach to Asynchronous Multivariate Time Series Anomaly Detection and Localization
    Abdulaal, Ahmed
    Liu, Zhuanghua
    Lancewicki, Tomer
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 2485 - 2494
  • [2] Anderson O., 1976, J. R. Stat. Soc. Ser. D
  • [3] Ayodeji A, 2020, NUCL ENG TECHNOL, V52, P2687
  • [4] Detecting Regions of Maximal Divergence for Spatio-Temporal Anomaly Detection
    Barz, Bjorn
    Rodner, Erik
    Garcia, Yanira Guanche
    Denzler, Joachim
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (05) : 1088 - 1101
  • [5] Beeram S.R., 2020, Commun. Softw. Netw. Proc. INDIA, V2019, P119
  • [6] Unsupervised outlier detection for time series by entropy and dynamic time warping
    Benkabou, Seif-Eddine
    Benabdeslem, Khalid
    Canitia, Bruno
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 54 (02) : 463 - 486
  • [7] Bin Z, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4433
  • [8] LOF: Identifying density-based local outliers
    Breunig, MM
    Kriegel, HP
    Ng, RT
    Sander, J
    [J]. SIGMOD RECORD, 2000, 29 (02) : 93 - 104
  • [9] Brown TB, 2020, ADV NEUR IN, V33
  • [10] Chauhan M, 2015, 2015 IEEE INTERNATIONAL CONFERENCE ON MICROELECTRONICS SYSTEMS EDUCATION (MSE)