Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals

被引:156
作者
Zhang, Yuxin [1 ,2 ,3 ]
Chen, Yiqiang [2 ,3 ,4 ]
Wang, Jindong [5 ]
Pan, Zhiwen [2 ,3 ]
机构
[1] Global Energy Interconnect Dev & Cooperat Org, Beijing 100031, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100864, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Peng ChengLaboratory PCL, Shenzhen 518066, Peoples R China
[5] Microsoft Res Asia, Beijing, Peoples R China
关键词
Anomaly detection; Predictive models; Data models; Autoregressive processes; Image reconstruction; Forecasting; Computational modeling; Unsupervised anomaly detection; multi-sensor time series; convolutional autoencoder; attention based BiLSTM; SUPPORT; NETWORK;
D O I
10.1109/TKDE.2021.3102110
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, multi-sensor technologies are applied in many fields, e.g., Health Care (HC), Human Activity Recognition (HAR), and Industrial Control System (ICS). These sensors can generate a substantial amount of multivariate time-series data. Unsupervised anomaly detection on multi-sensor time-series data has been proven critical in machine learning researches. The key challenge is to discover generalized normal patterns by capturing spatial-temporal correlation in multi-sensor data. Beyond this challenge, the noisy data is often intertwined with the training data, which is likely to mislead the model by making it hard to distinguish between the normal, abnormal, and noisy data. Few of previous researches can jointly address these two challenges. In this paper, we propose a novel deep learning-based anomaly detection algorithm called Deep Convolutional Autoencoding Memory network (CAE-M). We first build a Deep Convolutional Autoencoder to characterize spatial dependence of multi-sensor data with a Maximum Mean Discrepancy (MMD) to better distinguish between the noisy, normal, and abnormal data. Then, we construct a Memory Network consisting of linear (Autoregressive Model) and non-linear predictions (Bidirectional LSTM with Attention) to capture temporal dependence from time-series data. Finally, CAE-M jointly optimizes these two subnetworks. We empirically compare the proposed approach with several state-of-the-art anomaly detection methods on HAR and HC datasets. Experimental results demonstrate that our proposed model outperforms these existing methods.
引用
收藏
页码:2118 / 2132
页数:15
相关论文
共 75 条
  • [1] A data-driven metric learning-based scheme for unsupervised network anomaly detection
    Aliakbarisani, Roya
    Ghasemi, Abdorasoul
    Wu, Shyhtsun Felix
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2019, 73 : 71 - 83
  • [2] An J., 2015, SPECIAL LECT IE, V2, P1, DOI [10.1007/BF00758335, DOI 10.1007/BF00758335]
  • [3] Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community
    Ball, John E.
    Anderson, Derek T.
    Chan, Chee Seng
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2017, 11
  • [4] Consciousness is not a property of states: A reply to Wilberg
    Berger, Jacob
    [J]. PHILOSOPHICAL PSYCHOLOGY, 2014, 27 (06) : 829 - 842
  • [5] Chalapathy R, 2019, Arxiv, DOI arXiv:1901.03407
  • [6] Dynamic Illness Severity Prediction via Multi-task RNNs for Intensive Care Unit
    Chen, Weitong
    Wang, Sen
    Long, Guodong
    Yao, Lina
    Sheng, Quan Z.
    Li, Xue
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 917 - 922
  • [7] FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
    Chen, Yiqiang
    Qin, Xin
    Wang, Jindong
    Yu, Chaohui
    Gao, Wen
    [J]. IEEE INTELLIGENT SYSTEMS, 2020, 35 (04) : 83 - 93
  • [8] Cross-position activity recognition with stratified transfer learning
    Chen, Yiqiang
    Wang, Jindong
    Huang, Meiyu
    Yu, Han
    [J]. PERVASIVE AND MOBILE COMPUTING, 2019, 57 : 1 - 13
  • [9] Chung JY, 2014, Arxiv, DOI [arXiv:1412.3555, 10.48550/arXiv.1412.3555]
  • [10] Donahue J, 2015, PROC CVPR IEEE, P2625, DOI 10.1109/CVPR.2015.7298878