Anomaly Detection in Quasi-Periodic Time Series Based on Automatic Data Segmentation and Attentional LSTM-CNN

被引:45
作者
Liu, Fan [1 ]
Zhou, Xingshe [1 ]
Cao, Jinli [3 ]
Wang, Zhu [1 ]
Wang, Tianben [2 ]
Wang, Hua [4 ]
Zhang, Yanchun [4 ,5 ]
机构
[1] Northwestern Polytech Univ, Xian 710129, Peoples R China
[2] Northwest A&F Univ, Yangling 712100, Shaanxi, Peoples R China
[3] La Trobe Univ, Melbourne, Vic 3083, Australia
[4] Victoria Univ, Melbourne, Vic 3011, Australia
[5] Guangzhou Univ, Guangzhou 510006, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Feature extraction; Market research; Electrocardiography; Fluctuations; Anomaly detection; Heart rate variability; Quasi-periodic time series; anomaly detection; data segmentation; classification; attentional model; LSTM; CNN; NETWORK MODEL; CLASSIFICATION;
D O I
10.1109/TKDE.2020.3014806
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Quasi-periodic time series (QTS) exists widely in the real world, and it is important to detect the anomalies of QTS. In this paper, we propose an automatic QTS anomaly detection framework (AQADF) consisting of a two-level clustering-based QTS segmentation algorithm (TCQSA) and a hybrid attentional LSTM-CNN model (HALCM). TCQSA first automatically splits the QTS into quasi-periods which are then classified by HALCM into normal periods or anomalies. Notably, TCQSA integrates a hierarchical clustering and the k-means technique, making itself highly universal and noise-resistant. HALCM hybridizes LSTM and CNN to simultaneously extract the overall variation trends and local features of QTS for modeling its fluctuation pattern. Furthermore, we embed a trend attention gate (TAG) into the LSTM, a feature attention mechanism (FAM) and a location attention mechanism (LAM) into the CNN to finely tune the extracted variation trends and local features according to their true importance to achieve a better representation of the fluctuation pattern of the QTS. On four public datasets, HALCM exceeds four state-of-the-art baselines and obtains at least 97.3 percent accuracy, TCQSA outperforms two cutting-edge QTS segmentation algorithms and can be applied to different types of QTSs. Additionally, the effectiveness of the attention mechanisms is quantitatively and qualitatively demonstrated.
引用
收藏
页码:2626 / 2640
页数:15
相关论文
共 39 条
[1]   A deep convolutional neural network model to classify heartbeats [J].
Acharya, U. Rajendra ;
Oh, Shu Lih ;
Hagiwara, Yuki ;
Tan, Jen Hong ;
Adam, Muhammad ;
Gertych, Arkadiusz ;
Tan, Ru San .
COMPUTERS IN BIOLOGY AND MEDICINE, 2017, 89 :389-396
[2]  
[Anonymous], 2020, DATA ASSETS PDF FILE
[3]  
[Anonymous], 2020, US
[4]  
Brophy E., 2018, PROC 29 IRISH SIGNAL, P1
[5]  
Chakraborty G., 2017, Time Series Analysis and Forecasting, P147
[6]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[7]  
Chen K., 2015, Abc-cnn: An attention based convolutional neural network for visual question answering
[8]   SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning [J].
Chen, Long ;
Zhang, Hanwang ;
Xiao, Jun ;
Nie, Liqiang ;
Shao, Jian ;
Liu, Wei ;
Chua, Tat-Seng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6298-6306
[9]  
Chuah MC, 2007, LECT NOTES COMPUT SC, V4743, P123
[10]   DIAGNOSIS OF MULTICLASS TACHYCARDIA BEATS USING RECURRENCE QUANTIFICATION ANALYSIS AND ENSEMBLE CLASSIFIERS [J].
Desai, Usha ;
Martis, Roshan Joy ;
Acharya, U. Rajendra ;
Nayak, C. Gurudas ;
Seshikala, G. ;
Shetty, Ranjan K. .
JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2016, 16 (01)