Multi-head CNN-RNN for multi-time series anomaly detection: An industrial case study

被引:272
作者
Canizo, Mikel [1 ]
Triguero, Isaac [2 ]
Conde, Angel [1 ]
Onieva, Enrique [3 ]
机构
[1] Ikerlan Technol Res Ctr, PJ Ma Arizmendiarrieta 2, Arrasate Mondragon 20500, Spain
[2] Univ Nottingham, Sch Comp Sci, Optimisat & Learning Lab, Jubilee Campus,Wollaton Rd, Nottingham NG8 1BB, England
[3] Univ Deusto, Deusto Inst Technol DeustoTech, Ave Universidades 24, Bilbao 48007, Spain
关键词
Deep learning; Anomaly detection; Convolutional neural networks; Recurrent neural networks; Multi-sensor systems; Industry; 4.0; CONVOLUTIONAL NEURAL-NETWORKS; STATISTICAL COMPARISONS; ACTIVITY RECOGNITION; CLASSIFICATION; ARCHITECTURE; CLASSIFIERS; ALGORITHM; ENTROPY;
D O I
10.1016/j.neucom.2019.07.034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting anomalies in time series data is becoming mainstream in a wide variety of industrial applications in which sensors monitor expensive machinery. The complexity of this task increases when multiple heterogeneous sensors provide information of different nature, scales and frequencies from the same machine. Traditionally, machine learning techniques require a separate data pre-processing before training, which tends to be very time-consuming and often requires domain knowledge. Recent deep learning approaches have shown to perform well on raw time series data, eliminating the need for pre-processing. In this work, we propose a deep learning based approach for supervised multi-time series anomaly detection that combines a Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) in different ways. Unlike other approaches, we use independent CNNs, so-called convolutional heads, to deal with anomaly detection in multi-sensor systems. We address each sensor individually avoiding the need for data pre-processing and allowing for a more tailored architecture for each type of sensor. We refer to this architecture as Multi-head CNN-RNN. The proposed architecture is assessed against a real industrial case study, provided by an industrial partner, where a service elevator is monitored. Within this case study, three type of anomalies are considered: point, context-specific, and collective. The experimental results show that the proposed architecture is suitable for multi-time series anomaly detection as it obtained promising results on the real industrial scenario. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:246 / 260
页数:15
相关论文
共 85 条
[1]   To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques [J].
Abdi, Lida ;
Hashemi, Sattar .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) :238-251
[2]   Unsupervised real-time anomaly detection for streaming data [J].
Ahmad, Subutai ;
Lavin, Alexander ;
Purdy, Scott ;
Agha, Zuha .
NEUROCOMPUTING, 2017, 262 :134-147
[3]   Computer vision and deep learning-based data anomaly detection method for structural health monitoring [J].
Bao, Yuequan ;
Tang, Zhiyi ;
Li, Hui ;
Zhang, Yufeng .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2019, 18 (02) :401-421
[4]   Unsupervised outlier detection for time series by entropy and dynamic time warping [J].
Benkabou, Seif-Eddine ;
Benabdeslem, Khalid ;
Canitia, Bruno .
KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 54 (02) :463-486
[5]   Collective Anomaly Detection Based on Long Short-Term Memory Recurrent Neural Networks [J].
Bontemps, Loic ;
Van Loi Cao ;
McDermott, James ;
Nhien-An Le-Khac .
FUTURE DATA AND SECURITY ENGINEERING, FDSE 2016, 2016, 10018 :141-152
[6]   Spatial anomaly detection in sensor networks using neighborhood information [J].
Bosman, Hedde H. W. J. ;
Iacca, Giovanni ;
Tejada, Arturo ;
Wortche, Heinrich J. ;
Liotta, Antonio .
INFORMATION FUSION, 2017, 33 :41-56
[7]   Deep learning for freezing of gait detection in Parkinson's disease patients in their homes using a waist-worn inertial measurement unit [J].
Camps, Julia ;
Sama, Albert ;
Martin, Mario ;
Rodriguez-Martin, Daniel ;
Perez-Lopez, Carlos ;
Moreno Arostegui, Joan M. ;
Cabestany, Joan ;
Catala, Andreu ;
Alcaine, Sheila ;
Mestre, Berta ;
Prats, Anna ;
Crespo-Maraver, Maria C. ;
Counihan, Timothy J. ;
Browne, Patrick ;
Quinlan, Leo R. ;
Laighin, Gearoid O. ;
Sweeney, Dean ;
Lewy, Hadas ;
Vainstein, Gabriel ;
Costa, Alberto ;
Annicchiarico, Roberta ;
Bayes, Angels ;
Rodriguez-Molinero, Alejandro .
KNOWLEDGE-BASED SYSTEMS, 2018, 139 :119-131
[8]   Integrated Oversampling for Imbalanced Time Series Classification [J].
Cao, Hong ;
Li, Xiao-Li ;
Woon, David Yew-Kwong ;
Ng, See-Kiong .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (12) :2809-2822
[9]   Optimizing multi-sensor deployment via ensemble pruning for wearable activity recognition [J].
Cao, Jingjing ;
Li, Wenfeng ;
Ma, Congcong ;
Tao, Zhiwen .
INFORMATION FUSION, 2018, 41 :68-79
[10]   Short-long term anomaly detection in wireless sensor networks based on machine learning and multi-parameterized edit distance [J].
Cauteruccio, Francesco ;
Fortino, Giancarlo ;
Guerrieri, Antonio ;
Liotta, Antonio ;
Mocanu, Decebal Constantin ;
Perra, Cristian ;
Terracina, Giorgio ;
Vega, Maria Torres .
INFORMATION FUSION, 2019, 52 :13-30