A robust multi-scale feature extraction framework with dual memory module for multivariate time series detection

被引:1
|
作者
Xue, Bing [1 ]
Gao, Xin [1 ]
Li, Baofeng [2 ]
Zhai, Feng [2 ,3 ]
Lu, Jiansheng [4 ]
Yu, Jiahao [1 ]
Fu, Shiyuan [1 ,4 ]
Xiao, Chun
机构
[1] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] China Elect Power Res Inst Co Ltd, Beijing 100192, Peoples R China
[3] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[4] State Grid Shanxi Mkt Serv Ctr, Taiyuan 030032, Peoples R China
关键词
Anomaly detection; Multivariate time series; Robust feature extraction; Multi-scale global-local memory module; ANOMALY DETECTION; NETWORK;
D O I
10.1016/j.neunet.2024.106395
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although existing reconstruction -based multivariate time series anomaly detection (MTSAD) methods have shown advanced performance, most assume the training data is clean. When faced with noise or contamination in training data, they can also reconstruct the anomaly well, weakening the distinction between normal and anomaly. Some probabilistic generation -based methods have been used to address this issue because of their implicit robust structure to noise, but the training process and suppression of anomalous generalization are not stable. The recently proposed explicit method based on the memory module would also sacrifice the reconstruction effect of normal patterns, resulting in limited performance improvement. Moreover, most existing MTSAD methods use a single fixed -length window for input, which weakens their ability to extract long-term dependency. This paper proposes a robust multi -scale feature extraction framework with the dual memory module to comprehensively extract features fusing different levels of semantic information and lengths of temporal dependency. First, this paper designs consecutive neighboring windows as inputs to allow the model to extract local and long-term dependency information. Secondly, a dual memory -augmented encoder is proposed to extract global typical patterns and local common features. It ensures the reconstruction ability of normal data while suppressing the generalization of the anomaly. Finally, this paper proposes a multiscale fusion module to fuse latent variables representing different levels of semantic information and uses the reconstructed latent variables to reconstruct samples for anomaly detection. Experimental results on five datasets from diverse domains show that the proposed method outperforms 16 typical baseline methods.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Probabilistic autoencoder with multi-scale feature extraction for multivariate time series anomaly detection
    Zhang, Guangyao
    Gao, Xin
    Wang, Lei
    Xue, Bing
    Fu, Shiyuan
    Yu, Jiahao
    Huang, Zijian
    Huang, Xu
    APPLIED INTELLIGENCE, 2023, 53 (12) : 15855 - 15872
  • [2] Probabilistic autoencoder with multi-scale feature extraction for multivariate time series anomaly detection
    Guangyao Zhang
    Xin Gao
    Lei Wang
    Bing Xue
    Shiyuan Fu
    Jiahao Yu
    Zijian Huang
    Xu Huang
    Applied Intelligence, 2023, 53 : 15855 - 15872
  • [3] Time Series Prediction Based on Multi-Scale Feature Extraction
    Zhang, Ruixue
    Hao, Yongtao
    MATHEMATICS, 2024, 12 (07)
  • [4] MSPatch: A multi-scale patch mixing framework for multivariate time series forecasting
    Cao, Yizhi
    Tian, Zijian
    Guo, Wenjie
    Liu, Xinggao
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 273
  • [5] SCMA: Exploring Dual-Module Attention With Multi-Scale Kernels for Effective Feature Extraction
    Samad, Shaikh Abdus
    Gitanjali, J.
    IEEE ACCESS, 2023, 11 : 132088 - 132100
  • [6] A Multi-scale Parallel Unsupervised Model for Multivariate Time Series Anomaly Detection
    Bao, Junpeng
    Gao, Han
    Zhang, Chengpu
    Jia, Wentao
    Gao, Junzhe
    Yang, Tongzhi
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, PT IV, AIAI 2024, 2024, 714 : 241 - 251
  • [7] Time series anomaly detection based on multi-scale feature information fusion
    Heng, Hongjun
    Yu, Longwei
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2024, 51 (03): : 203 - 214
  • [8] Remote sensing multi-scale object detection based on multivariate feature extraction and characterization optimization
    Meng Y.
    Wang F.
    Liu G.
    Xu S.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (16): : 2465 - 2482
  • [9] Multi-scale image hashing using adaptive local feature extraction for robust tampering detection
    Yan, Cai-Ping
    Pun, Chi-Man
    Yuan, Xiao-Chen
    SIGNAL PROCESSING, 2016, 121 : 1 - 16
  • [10] Weed Detection Based on Multi-scale Fusion Module and Feature Enhancement
    Kang J.
    Liu G.
    Guo G.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2022, 53 (04): : 254 - 260