Triple Attention: An Integrated Approach for Interpretable Anomaly Detection in Temporal and Association Dimensions

被引:0
作者
Yu, Bing [1 ]
Yu, Yang [1 ]
Xiang, Gang [2 ]
Lin, RuiShi [2 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[2] Beijing Aerosp Automat Control Inst, Dept Syst Engn, Beijing 100854, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Time series analysis; Feature extraction; Actuators; Correlation; Sensor phenomena and characterization; Safety; graph neural network; industrial system; interpretability; multidimensional time series; GRAPH NEURAL-NETWORK;
D O I
10.1109/TIM.2024.3460930
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the increasing complexity of industrial systems and the rise in automation levels, their safety and reliability have assumed greater importance. In operation, actuators and sensors generate a large amount of multivariate time series (MTS) data, wherein anomalous patterns could indicate malfunctions. However, existing methods for detecting anomalies in MTS often struggle with accuracy, particularly in complex industrial environments, and frequently lack interpretability of detected anomalies. Specifically, many current approaches fail to effectively capture temporal dependencies and parameter coupling relationships, leading to suboptimal detection performance. To address these issues, we propose a triple attention graph (TAG) structure, which integrates a triple attention mechanism and a normalized flow-based explainable graph encoder. The graph encoder applies Attention-enhanced long short-term memory (LSTM) to capture temporal features, focusing particularly on detecting temporal anomalies. Subsequently, through edge attention, we emphasize parameter coupling relationships and highlight parameters that trigger anomalies via a global attention mechanism. Finally, we integrate the features extracted by the graph encoder with conditional probability and normalized flow to assess the density of the time series. This model facilitates anomaly detection through anomaly density estimation and provides explanations for anomalies through attention coefficients. To validate TAG's effectiveness, we tested it on two publicly available datasets. The results demonstrate superior detection accuracy and recall rates compared with existing methods. Furthermore, we present a detailed analysis of our approach's interpretability in terms of temporal characteristics, associations, and global perspectives through a case study.
引用
收藏
页数:12
相关论文
共 36 条
  • [1] Ahmed C.M., 2017, P 3 INT WORKSH CYB P, P25, DOI DOI 10.1145/3055366.3055375
  • [2] Outlier mining in large high-dimensional data sets
    Angiulli, F
    Pizzuti, C
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (02) : 203 - 215
  • [3] Graph Neural Network: A Comprehensive Review on Non-Euclidean Space
    Asif, Nurul A.
    Sarker, Yeahia
    Chakrabortty, Ripon K.
    Ryan, Michael J.
    Ahamed, Md. Hafiz
    Saha, Dip K.
    Badal, Faisal R.
    Das, Sajal K.
    Ali, Md. Firoz
    Moyeen, Sumaya I.
    Islam, Md. Robiul
    Tasneem, Zinat
    [J]. IEEE ACCESS, 2021, 9 : 60588 - 60606
  • [4] USAD : UnSupervised Anomaly Detection on Multivariate Time Series
    Audibert, Julien
    Michiardi, Pietro
    Guyard, Frederic
    Marti, Sebastien
    Zuluaga, Maria A.
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3395 - 3404
  • [5] Deep Learning for Anomaly Detection in Time-Series Data: Review, Analysis, and Guidelines
    Choi, Kukjin
    Yi, Jihun
    Park, Changhwa
    Yoon, Sungroh
    [J]. IEEE ACCESS, 2021, 9 : 120043 - 120065
  • [6] Daehyung Park, 2018, IEEE Robotics and Automation Letters, V3, P1544, DOI 10.1109/LRA.2018.2801475
  • [7] Deng AL, 2021, AAAI CONF ARTIF INTE, V35, P4027
  • [8] Dinh L, 2017, Arxiv, DOI arXiv:1605.08803
  • [9] Fey M, 2019, Arxiv, DOI [arXiv:1903.02428, DOI 10.48550/ARXIV.1903.02428]
  • [10] DASVDD: Deep Autoencoding Support Vector Data Descriptor for Anomaly Detection
    Hojjati, Hadi
    Armanfard, Narges
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 3739 - 3750