Multi-head CNN-RNN for multi-time series anomaly detection: An industrial case study

被引:273
作者
Canizo, Mikel [1 ]
Triguero, Isaac [2 ]
Conde, Angel [1 ]
Onieva, Enrique [3 ]
机构
[1] Ikerlan Technol Res Ctr, PJ Ma Arizmendiarrieta 2, Arrasate Mondragon 20500, Spain
[2] Univ Nottingham, Sch Comp Sci, Optimisat & Learning Lab, Jubilee Campus,Wollaton Rd, Nottingham NG8 1BB, England
[3] Univ Deusto, Deusto Inst Technol DeustoTech, Ave Universidades 24, Bilbao 48007, Spain
关键词
Deep learning; Anomaly detection; Convolutional neural networks; Recurrent neural networks; Multi-sensor systems; Industry; 4.0; CONVOLUTIONAL NEURAL-NETWORKS; STATISTICAL COMPARISONS; ACTIVITY RECOGNITION; CLASSIFICATION; ARCHITECTURE; CLASSIFIERS; ALGORITHM; ENTROPY;
D O I
10.1016/j.neucom.2019.07.034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting anomalies in time series data is becoming mainstream in a wide variety of industrial applications in which sensors monitor expensive machinery. The complexity of this task increases when multiple heterogeneous sensors provide information of different nature, scales and frequencies from the same machine. Traditionally, machine learning techniques require a separate data pre-processing before training, which tends to be very time-consuming and often requires domain knowledge. Recent deep learning approaches have shown to perform well on raw time series data, eliminating the need for pre-processing. In this work, we propose a deep learning based approach for supervised multi-time series anomaly detection that combines a Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) in different ways. Unlike other approaches, we use independent CNNs, so-called convolutional heads, to deal with anomaly detection in multi-sensor systems. We address each sensor individually avoiding the need for data pre-processing and allowing for a more tailored architecture for each type of sensor. We refer to this architecture as Multi-head CNN-RNN. The proposed architecture is assessed against a real industrial case study, provided by an industrial partner, where a service elevator is monitored. Within this case study, three type of anomalies are considered: point, context-specific, and collective. The experimental results show that the proposed architecture is suitable for multi-time series anomaly detection as it obtained promising results on the real industrial scenario. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:246 / 260
页数:15
相关论文
共 85 条
[71]  
Triguero I., 2018, REV DATA MIN KNOWL D, pe1289, DOI [10.1002/widm.1289, DOI 10.1002/WIDM.1289]
[72]   An analysis of Convolutional Long Short-Term Memory Recurrent Neural Networks for gesture recognition [J].
Tsironi, Eleni ;
Barros, Pablo ;
Weber, Cornelius ;
Wermter, Stefan .
NEUROCOMPUTING, 2017, 268 :76-86
[73]   Knowledge Guided Disambiguation for Large-Scale Scene Classification With Multi-Resolution CNNs [J].
Wang, Limin ;
Guo, Sheng ;
Huang, Weilin ;
Xiong, Yuanjun ;
Qiao, Yu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) :2055-2068
[74]   Geometric mean switching constant false alarm rate detector [J].
Weinberg, G. V. .
DIGITAL SIGNAL PROCESSING, 2017, 69 :1-10
[75]   A survey of transfer learning [J].
Weiss K. ;
Khoshgoftaar T.M. ;
Wang D.D. .
Journal of Big Data, 2016, 3 (01)
[76]   Industrial Big Data in an Industry 4.0 Environment: Challenges, Schemes, and Applications for Predictive Maintenance [J].
Yan, Jihong ;
Meng, Yue ;
Lu, Lei ;
Li, Lin .
IEEE ACCESS, 2017, 5 :23484-23491
[77]   An unsupervised spatiotemporal graphical modeling approach for wind turbine condition monitoring [J].
Yang, Wenguang ;
Liu, Chao ;
Jiang, Dongxiang .
RENEWABLE ENERGY, 2018, 127 :230-241
[78]   INTERNET OF THINGS ARCHITECTURE: RECENT ADVANCES, TAXONOMY, REQUIREMENTS, AND OPEN CHALLENGES [J].
Yaqoob, Ibrar ;
Ahmed, Ejaz ;
Hashem, Ibrahim Abaker Targio ;
Ahmed, Abdelmuttlib Ibrahim Abdalla ;
Gani, Abdullah ;
Imran, Muhammad ;
Guizani, Mohsen .
IEEE WIRELESS COMMUNICATIONS, 2017, 24 (03) :10-16
[79]  
Zhang B., 2015, FOOD ANAL METHOD, V8, P1, DOI [DOI 10.3390/RS8010010, DOI 10.1016/J.EXPNEUR0L.2015.08.001]
[80]   Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising [J].
Zhang, Kai ;
Zuo, Wangmeng ;
Chen, Yunjin ;
Meng, Deyu ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (07) :3142-3155