Invariant subspace learning for time series data based on dynamic time warping distance

被引:20
作者
Deng, Huiqi [1 ,2 ]
Chen, Weifu [1 ]
Shen, Qi [4 ]
Ma, Andy J. [3 ]
Yuen, Pong C. [2 ]
Feng, Guocan [1 ]
机构
[1] Sun Yat Sen Univ, Sch Math, Guangzhou, Peoples R China
[2] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[3] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
[4] Icahn Sch Med Mt Sinai, Dept Genet & Genom Sci, New York, NY 10029 USA
关键词
Invariant subspace learning; Dynamic time warping (DTW); Time series; Dictionary learning; KERNEL; REPRESENTATION; CLASSIFICATION; SPARSE;
D O I
10.1016/j.patcog.2020.107210
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-dimensional and compact representation of time series data is of importance for mining and storage. In practice, time series data are vulnerable to various temporal transformations, such as shift and temporal scaling, however, which are unavoidable in the process of data collection. If a learning algorithm directly calculates the difference between such transformed data based on Euclidean distance, the measurement cannot faithfully reflect the similarity and hence could not learn the underlying discriminative features. In order to solve this problem, we develop a novel subspace learning algorithm based on dynamic time warping (DTW) distance which is an elastic distance defined in a DTW space. The algorithm aims to minimize the reconstruction error in the DTW space. However, since DTW space is a semi-pseudo metric space, it is difficult to generalize common subspace learning algorithms for such semi-pseudo metric spaces. In this work, we introduce warp operators with which DTW reconstruction error can be approximated by reconstruction error between transformed series and their reconstructions in a subspace. The warp operators align time series data with their linear representations in the DTW space, which is in particular important for misaligned time series, so that the subspace can be learned to obtain an intrinsic basis (dictionary) for the representation of the data. The warp operators and the subspace are optimized alternatively until reaching equilibrium. Experiments results show that the proposed algorithm outperforms traditional subspace learning algorithms and temporal transform-invariance based methods (including SIDL, Kernel PCA, and SPMC et. al), and obtains competitive results with the state-of-the-art algorithms, such as BOSS algorithm. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 56 条
  • [11] Cuturi M, 2017, PR MACH LEARN RES, V70
  • [12] Cuturi Marco, 2011, P 28 INT C MACHINE L, P929
  • [13] Robust Shapelets Learning: Transform-Invariant Prototypes
    Deng, Huiqi
    Chen, Weifu
    Ma, Andy J.
    Shen, Qi
    Yuen, Pong C.
    Feng, Guocan
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PT III, 2018, 11258 : 491 - 502
  • [14] Donahue J, 2015, PROC CVPR IEEE, P2625, DOI 10.1109/CVPR.2015.7298878
  • [15] Dongyu Zhang, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P29, DOI 10.1109/ICPR.2010.16
  • [16] Duda R. O., 2012, PATTERN CLASSIFICATI, DOI DOI 10.1007/978-3-319-57027-3_4
  • [17] Multivariate time series classification with parametric derivative dynamic time warping
    Gorecki, Tomasz
    Luczak, Maciej
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (05) : 2305 - 2312
  • [18] Learning Time-Series Shapelets
    Grabocka, Josif
    Schilling, Nicolas
    Wistuba, Martin
    Schmidt-Thieme, Lars
    [J]. PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, : 392 - 401
  • [19] Grosse R., 2007, 23 C UNCERTAINTY ART, V23, P149
  • [20] Support Vector Machines and Dynamic Time Warping for Time Series
    Gudmundsson, Steinn
    Runarsson, Thomas Philip
    Sigurdsson, Sven
    [J]. 2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 2772 - +