Multi-head CNN-RNN for multi-time series anomaly detection: An industrial case study

被引:272
作者
Canizo, Mikel [1 ]
Triguero, Isaac [2 ]
Conde, Angel [1 ]
Onieva, Enrique [3 ]
机构
[1] Ikerlan Technol Res Ctr, PJ Ma Arizmendiarrieta 2, Arrasate Mondragon 20500, Spain
[2] Univ Nottingham, Sch Comp Sci, Optimisat & Learning Lab, Jubilee Campus,Wollaton Rd, Nottingham NG8 1BB, England
[3] Univ Deusto, Deusto Inst Technol DeustoTech, Ave Universidades 24, Bilbao 48007, Spain
关键词
Deep learning; Anomaly detection; Convolutional neural networks; Recurrent neural networks; Multi-sensor systems; Industry; 4.0; CONVOLUTIONAL NEURAL-NETWORKS; STATISTICAL COMPARISONS; ACTIVITY RECOGNITION; CLASSIFICATION; ARCHITECTURE; CLASSIFIERS; ALGORITHM; ENTROPY;
D O I
10.1016/j.neucom.2019.07.034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting anomalies in time series data is becoming mainstream in a wide variety of industrial applications in which sensors monitor expensive machinery. The complexity of this task increases when multiple heterogeneous sensors provide information of different nature, scales and frequencies from the same machine. Traditionally, machine learning techniques require a separate data pre-processing before training, which tends to be very time-consuming and often requires domain knowledge. Recent deep learning approaches have shown to perform well on raw time series data, eliminating the need for pre-processing. In this work, we propose a deep learning based approach for supervised multi-time series anomaly detection that combines a Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) in different ways. Unlike other approaches, we use independent CNNs, so-called convolutional heads, to deal with anomaly detection in multi-sensor systems. We address each sensor individually avoiding the need for data pre-processing and allowing for a more tailored architecture for each type of sensor. We refer to this architecture as Multi-head CNN-RNN. The proposed architecture is assessed against a real industrial case study, provided by an industrial partner, where a service elevator is monitored. Within this case study, three type of anomalies are considered: point, context-specific, and collective. The experimental results show that the proposed architecture is suitable for multi-time series anomaly detection as it obtained promising results on the real industrial scenario. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:246 / 260
页数:15
相关论文
共 85 条
[31]   Network Anomaly Detection System using Genetic Algorithm and Fuzzy Logic [J].
Hamamoto, Anderson Hiroshi ;
Carvalho, Luiz Fernando ;
Hiera Sampaio, Lucas Dias ;
Abrao, Taufik ;
Proenca, Mario Lemes, Jr. .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 92 :390-402
[32]   State-of-the-Art Predictive Maintenance Techniques [J].
Hashemian, H. M. ;
Bean, Wendell C. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2011, 60 (10) :3480-3492
[33]   Geometric means and medians with applications to target detection [J].
Hua, Xiaoqiang ;
Cheng, Yongqiang ;
Wang, Hongqiang ;
Qin, Yuliang ;
Li, Yubo .
IET SIGNAL PROCESSING, 2017, 11 (06) :711-720
[34]   Detecting Anomalies in Time Series Data via a Meta-Feature Based Approach [J].
Hui, Min ;
Ji, Zhiwei ;
Yan, Ke ;
Guo, Ye ;
Feng, Xiaowei ;
Gong, Jiaheng ;
Zhao, Xin ;
Dong, Ligang .
IEEE ACCESS, 2018, 6 :27760-27776
[35]   Product Line Engineering of Monitoring Functionality in Industrial Cyber-Physical Systems: A Domain Analysis [J].
Iglesias, Aitziber ;
Lu, Hong ;
Arellano, Cristobal ;
Yue, Tao ;
Ali, Shaukat ;
Sagardui, Goiuria .
21ST INTERNATIONAL SYSTEMS & SOFTWARE PRODUCT LINE CONFERENCE (SPLC 2017), VOL 1, 2017, :195-204
[36]   Real-time human activity recognition from accelerometer data using Convolutional Neural Networks [J].
Ignatov, Andrey .
APPLIED SOFT COMPUTING, 2018, 62 :915-922
[37]  
Ioffe S, 2015, 32 INT C MACH LEARN
[38]   Detecting anomalies in time series data via a deep learning algorithm combining wavelets, neural networks and Hilbert transform [J].
Kanarachos, Stratis ;
Christopoulos, Stavros-Richard G. ;
Chroneos, Alexander ;
Fitzpatrick, Michael E. .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 85 :292-304
[39]   Deep learning analysis of mobile physiological, environmental and location sensor data for emotion detection [J].
Kanjo, Eiman ;
Younis, Eman M. G. ;
Ang, Chee Siang .
INFORMATION FUSION, 2019, 49 :46-56
[40]   Web traffic anomaly detection using C-LSTM neural networks [J].
Kim, Tae-Young ;
Cho, Sung-Bae .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 106 :66-76