Multivariate LSTM-FCNs for time series classification

被引:659
作者
Karim, Fazle [1 ]
Majumdar, Somshubra [2 ]
Darabi, Houshang [1 ]
Harford, Samuel [1 ]
机构
[1] Univ Illinois, Mech & Ind Engn, 900 W Taylor St, Chicago, IL 60607 USA
[2] Univ Illinois, Comp Sci, 900 W Taylor St, Chicago, IL 60607 USA
关键词
Convolutional neural network; Long short term memory; Recurrent neural network; Multivariate time series classification; NEURAL-NETWORKS; REPRESENTATION;
D O I
10.1016/j.neunet.2019.04.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Over the past decade, multivariate time series classification has received great attention. We propose transforming the existing univariate time series classification models, the Long Short Term Memory Fully Convolutional Network (LSTM-FCN) and Attention LSTM-FCN (ALSTM-FCN), into a multivariate time series classification model by augmenting the fully convolutional block with a squeeze-and-excitation block to further improve accuracy. Our proposed models outperform most state-of-the-art models while requiring minimum preprocessing. The proposed models work efficiently on various complex multivariate time series classification tasks such as activity recognition or action recognition. Furthermore, the proposed models are highly efficient at test time and small enough to deploy on memory constrained systems. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:237 / 245
页数:9
相关论文
共 49 条
[1]  
Abadi M., 2015, TENSORFLOW LARGE SCA
[2]  
[Anonymous], IEEE T NEURAL NETWOR
[3]  
Bache K., 2013, UCI machine learning repository
[4]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[5]   Time series representation and similarity based on local autopatterns [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2016, 30 (02) :476-509
[6]   Learning a symbolic representation for multivariate time series classification [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (02) :400-422
[7]  
Carnegie Mellon University, 2000, CMU GRAPH LAB MOT CA
[8]  
Chollet F., 2015, Keras
[9]   Complex Rotation Quantum Dynamic Neural Networks (CRQDNN) using Complex Quantum Neuron (CQN): Applications to time series prediction [J].
Cui, Yiqian ;
Shi, Junyou ;
Wang, Zili .
NEURAL NETWORKS, 2015, 71 :11-26
[10]  
Cuturi M., 2011, ARXIV11010673