Difference-Guided Representation Learning Network for Multivariate Time-Series Classification

被引:13
作者
Ma, Qianli [1 ]
Chen, Zipeng [1 ]
Tian, Shuai [1 ]
Ng, Wing W. Y. [1 ,2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Guangdong Prov Key Lab Computat Intelligence & Cy, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series analysis; Feature extraction; Support vector machines; Hidden Markov models; Time measurement; Data mining; Principal component analysis; Convolutional neural network (CNN); long short-term memory network (LSTM); multivariate time-series (MTS) classification; temporal difference information;
D O I
10.1109/TCYB.2020.3034755
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multivariate time series (MTSs) are widely found in many important application fields, for example, medicine, multimedia, manufacturing, action recognition, and speech recognition. The accurate classification of MTS has become an important research topic. Traditional MTS classification methods do not explicitly model the temporal difference information of time series, which is, in fact, important and reflects the dynamic evolution information. In this article, the difference-guided representation learning network (DGRL-Net) is proposed to guide the representation learning of time series by dynamic evolution information. The DGRL-Net consists of a difference-guided layer and a multiscale convolutional layer. First, in the difference-guided layer, we propose a difference gating LSTM to model the time dependency and dynamic evolution of the time series to obtain feature representations of both raw and difference series. Then, these two representations are used as two input channels of the multiscale convolutional layer to extract multiscale information. Extensive experiments demonstrate that the proposed model outperforms state-of-the-art methods on 18 MTS benchmark datasets and achieves competitive results on two skeleton-based action recognition datasets. Furthermore, the ablation study and visualized analysis are designed to verify the effectiveness of the proposed model.
引用
收藏
页码:4717 / 4727
页数:11
相关论文
共 57 条
[41]   Learning a Mahalanobis Distance-Based Dynamic Time Warping Measure for Multivariate Time Series Classification [J].
Mei, Jiangyuan ;
Liu, Meizhu ;
Wang, Yuan-Fang ;
Gao, Huijun .
IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (06) :1363-1374
[42]  
MOZER MC, 1992, ADV NEUR IN, V4, P275
[43]   Univariate and Multivariate Time Series Manifold Learning [J].
O'Reilly, Colin ;
Moessner, Klaus ;
Nati, Michele .
KNOWLEDGE-BASED SYSTEMS, 2017, 133 :1-16
[44]  
Olszewski R. T., 2001, Tech. Rep. CMU-CS-01-108
[45]  
Ordonez P., 2011, 2011 IEEE International Conference on Data Mining Workshops, P534, DOI 10.1109/ICDMW.2011.174
[46]   Combining discrete SVM and fixed cardinality warping distances for multivariate time series classification [J].
Orsenigo, C. ;
Vercellis, C. .
PATTERN RECOGNITION, 2010, 43 (11) :3787-3794
[47]   Multivariate Time-Series Classification Using the Hidden-Unit Logistic Model [J].
Pei, Wenjie ;
Dibeklioglu, Hamdi ;
Tax, David M. J. ;
van der Maaten, Laurens .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (04) :920-931
[48]   Lagrangian-based Pattern Extraction for Edge Computing in the Internet of Things [J].
Rezvani, Roonak ;
Enshaeifar, Shirin ;
Barnaghi, Payam .
2019 6TH IEEE INTERNATIONAL CONFERENCE ON CYBER SECURITY AND CLOUD COMPUTING (IEEE CSCLOUD 2019) / 2019 5TH IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND SCALABLE CLOUD (IEEE EDGECOM 2019), 2019, :177-182
[49]  
Shell M., 2012, Carnegie mellon university motion capture database
[50]  
Srivastava N, 2014, J MACH LEARN RES, V15, P1929