Attention-Based Deep Gated Fully Convolutional End-to-End Architectures for Time Series Classification

被引:6
作者
Khan, Mehak [1 ]
Wang, Hongzhi [1 ]
Ngueilbaye, Alladoumbaye [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
关键词
Attention mechanism; Convolutional neural network; Squeeze-and-excitation; Gated recurrent unit; Univariate time series classification; Multivariate time series classification; SYMBOLIC REPRESENTATION; LSTM; NETWORKS;
D O I
10.1007/s11063-021-10484-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series classification (TSC) is one of the significant problems in the data mining community due to the wide class of domains involving the time series data. The TSC problem is being studied individually for univariate and multivariate using different datasets and methods. Subsequently, deep learning methods are more robust than other techniques and revolutionized many areas, including TSC. Therefore, in this study, we exploit the performance of attention mechanism, deep Gated Recurrent Unit (dGRU), Squeeze-and-Excitation (SE) block, and Fully Convolutional Network (FCN) in two end-to-end hybrid deep learning architectures, Att-dGRU-FCN and Att-dGRU-SE-FCN. The performance of the proposed models is evaluated in terms of classification testing error and f1-score. Extensive experiments and ablation study is carried out on multiple univariate and multivariate datasets from different domains to acquire the best performance of the proposed models. The proposed models show effective performance over other published methods, also do not require heavy data pre-processing, and small enough to be deployed on real-time systems.
引用
收藏
页码:1995 / 2028
页数:34
相关论文
共 46 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Time Series Classification in Reservoir- and Model-Space [J].
Aswolinskiy, Witali ;
Reinhart, Rene Felix ;
Steil, Jochen .
NEURAL PROCESSING LETTERS, 2018, 48 (02) :789-809
[3]   Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles [J].
Bagnall, Anthony ;
Lines, Jason ;
Hills, Jon ;
Bostrom, Aaron .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (09) :2522-2535
[4]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[5]   Learning a symbolic representation for multivariate time series classification [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (02) :400-422
[6]   A Bag-of-Features Framework to Classify Time Series [J].
Baydogan, Mustafa Gokce ;
Runger, George ;
Tuv, Eugene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2796-2802
[7]  
Chen Yanping, 2015, The ucr time series classification archive
[8]  
Chung J., 2014, Empirical evaluation of gated recurrent neural networks on sequence modeling
[9]   ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels [J].
Dempster, Angus ;
Petitjean, Francois ;
Webb, Geoffrey, I .
DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (05) :1454-1495
[10]  
Dua D., 2017, UCI machine learning repository