RTFN: A robust temporal feature network for time series classification

被引:144
作者
Xiao, Zhiwen [1 ]
Xu, Xin [2 ]
Xing, Huanlai [1 ]
Luo, Shouxi [1 ]
Dai, Penglin [1 ]
Zhan, Dawei [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu, Peoples R China
[2] China Univ Min & Technol, Xuzhou, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Attention mechanism; Convolutional neural network; Data mining; LSTM; Time series classification; REPRESENTATION; LSTM;
D O I
10.1016/j.ins.2021.04.053
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time series data usually contains local and global patterns. Most of the existing feature networks focus on local features rather than the relationships among them. The latter is also essential, yet more difficult to explore because it is challenging to obtain sufficient rep-resentations using a feature network. To this end, we propose a novel robust temporal fea-ture network (RTFN) for feature extraction in time series classification, containing a temporal feature network (TFN) and a long short-term memory (LSTM)-based attention network (LSTMaN). TFN is a residual structure with multiple convolutional layers, and functions as a local-feature extraction network to mine sufficient local features from data. LSTMaN is composed of two identical layers, where attention and LSTM networks are hybridized. This network acts as a relation extraction network to discover the intrinsic rela-tionships among the features extracted from different data positions. In experiments, we embed the RTFN into supervised and unsupervised structures as a feature extractor and encoder, respectively. The results show that the RTFN-based structures achieve excellent supervised and unsupervised performances on a large number of UCR2018 and UEA2018 datasets. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:65 / 86
页数:22
相关论文
共 50 条
[1]   Time series representation and similarity based on local autopatterns [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2016, 30 (02) :476-509
[2]   Learning a symbolic representation for multivariate time series classification [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (02) :400-422
[3]   A Bag-of-Features Framework to Classify Time Series [J].
Baydogan, Mustafa Gokce ;
Runger, George ;
Tuv, Eugene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2796-2802
[4]   STDPG: A Spatio-Temporal Deterministic Policy Gradient Agent for Dynamic Routing in SDN [J].
Chen, Juan ;
Xiao, Zhiwen ;
Xing, Huanlai ;
Dai, Penglin ;
Luo, Shouxi ;
Iqbal, Muhammad Azhar .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[5]   Temporally Identity-Aware SSD With Attentional LSTM [J].
Chen, Xingyu ;
Yu, Junzhi ;
Wu, Zhengxing .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (06) :2674-2686
[6]   A time series forest for classification and feature extraction [J].
Deng, Houtao ;
Runger, George ;
Tuv, Eugene ;
Vladimir, Martyanov .
INFORMATION SCIENCES, 2013, 239 :142-153
[7]   TSI: Time series to imaging based model for detecting anomalous energy consumption in smart buildings [J].
Fahim, Muhammad ;
Fraz, Khadija ;
Sillitti, Alberto .
INFORMATION SCIENCES, 2020, 523 :1-13
[8]   InceptionTime: Finding AlexNet for time series classification [J].
Fawaz, Hassan Ismail ;
Lucas, Benjamin ;
Forestier, Germain ;
Pelletier, Charlotte ;
Schmidt, Daniel F. ;
Weber, Jonathan ;
Webb, Geoffrey, I ;
Idoumghar, Lhassane ;
Muller, Pierre-Alain ;
Petitjean, Francois .
DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (06) :1936-1962
[9]   Adversarial Attacks on Deep Neural Networks for Time Series Classification [J].
Fawaz, Hassan Ismail ;
Forestier, Germain ;
Weber, Jonathan ;
Idoumghar, Lhassane ;
Muller, Pierre-Alain .
2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
[10]   Deep learning for time series classification: a review [J].
Fawaz, Hassan Ismail ;
Forestier, Germain ;
Weber, Jonathan ;
Idoumghar, Lhassane ;
Muller, Pierre-Alain .
DATA MINING AND KNOWLEDGE DISCOVERY, 2019, 33 (04) :917-963