Time-Series Multi-Instance Learning for Weakly Supervised Industrial Fault Detection

被引:0
作者
Liu, Chen [1 ]
He, Shibo [1 ]
Li, Shizhong [1 ]
Shi, Zhenyu [1 ]
Meng, Wenchao [1 ]
机构
[1] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
关键词
Training; Fault detection; Testing; Time series analysis; Feature extraction; Informatics; Fast Fourier transforms; Annotations; Vector quantization; Forecasting; Industrial fault detection; inexact supervision; multi-instance learning (MIL); time series;
D O I
10.1109/TII.2024.3523591
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time-series anomaly detection plays a crucial role in industrial fault detection. Most existing studies follow either an unsupervised setting, which is prone to false alarms, or a supervised setting, which is time-consuming and labor-intensive. To address these limitations, we adopt an innovative weakly supervised paradigm for industrial fault detection, where segment-level labels are provided during training, while point-level predictions are made during inference. Within this paradigm, we propose an innovative C-ary tree-based multi-instance learning (MIL) framework. First, the entire time series is represented as a C-ary tree, where nodes representing subsequences of different lengths are treated as instances in the MIL framework. This design allows for the detection of both point and collective anomalies. Second, to detect out-of-distribution (OOD) anomalies that are not visible during training, we develop a vector quantization module to memorize regular historical patterns. OOD anomalies are then detected when they show significant discrepancies from all memorized patterns. Finally, we enhance the MIL framework with an attention-based pooling mechanism that allocates greater focus on anomalous instances, further improving detection performance. To validate the effectiveness of our method, we conduct experiments on four real-world industrial time-series datasets. The results show that our method outperforms existing approaches by at least 6.01% in AUROC under weak supervision.
引用
收藏
页码:3326 / 3335
页数:10
相关论文
共 32 条
  • [1] Principal component analysis
    Abdi, Herve
    Williams, Lynne J.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2010, 2 (04): : 433 - 459
  • [2] Ahmed C M., 2017, P INT WORKSH CYSWATE, P25, DOI 10.1145/3055366.3055375
  • [3] A Review on Outlier/Anomaly Detection in Time Series Data
    Blazquez-Garcia, Ane
    Conde, Angel
    Mori, Usue
    Lozano, Jose A.
    [J]. ACM COMPUTING SURVEYS, 2022, 54 (03)
  • [4] LOF: Identifying density-based local outliers
    Breunig, MM
    Kriegel, HP
    Ng, RT
    Sander, J
    [J]. SIGMOD RECORD, 2000, 29 (02) : 93 - 104
  • [5] Real-World Anomaly Detection by Using Digital Twin Systems and Weakly Supervised Learning
    Castellani, Andrea
    Schmitt, Sebastian
    Squartini, Stefano
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4733 - 4742
  • [6] Interaction-Aware Graph Neural Networks for Fault Diagnosis of Complex Industrial Processes
    Chen, Dongyue
    Liu, Ruonan
    Hu, Qinghua
    Ding, Steven X.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) : 6015 - 6028
  • [7] Dai E., 2021, P INT C LEARN REPR, P1
  • [8] Deng AL, 2021, AAAI CONF ARTIF INTE, V35, P4027
  • [9] Reward Once, Penalize Once: Rectifying Time Series Anomaly Detection
    Doshi, Keval
    Abudalou, Shatha
    Yilmaz, Yasin
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [10] A Semi-Supervised VAE Based Active Anomaly Detection Framework in Multivariate Time Series for Online Systems
    Huang, Tao
    Chen, Pengfei
    Li, Ruipeng
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1797 - 1806