Integration of residual network and convolutional neural network along with various activation functions and global pooling for time series classification

被引:61
作者
Zou, Xiaowu [1 ]
Wang, Zidong [2 ]
Li, Qi [1 ]
Sheng, Weiguo [1 ]
机构
[1] Hangzhou Normal Univ, Dept Comp Sci, Hangzhou, Zhejiang, Peoples R China
[2] Brunel Univ London, Dept Comp Sci, Uxbridge UB8 3PH, Middx, England
基金
中国国家自然科学基金;
关键词
Time series classification; Residual network; Convolutional neural network; Deep learning; REPRESENTATION;
D O I
10.1016/j.neucom.2019.08.023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we devise a hybrid scheme, which integrates residual network with convolutional neural network, for time series classification. In the devised method, the architecture of network is constructed by facilitating a residual learning block at the first three convolutional layers to combine the strength of both methods. Further, different activation functions are used in different layers to achieve a decent abstraction. Additionally, to alleviate overfitting, the pooling operation is removed and the features are fed into a global average pooling instead of a fully connected layer. The resulting scheme requires no heavy preprocessing of raw data or feature crafting, thus could be easily deployed. To evaluate our method, we test it on 44 benchmark datasets and compare its performance with related methods. The results show that our method can deliver competitive performance among state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:39 / 45
页数:7
相关论文
共 45 条
[1]  
[Anonymous], P 23 INT JOINT C ART
[2]  
[Anonymous], 2013, INT C MACHINE LEARNI
[3]  
[Anonymous], 2011, P 2011 SIAM INT C DA, DOI [DOI 10.1137/1.9781611972818.60, 10. 1137/1.9781611972818.60]
[4]  
[Anonymous], ADV NEURAL INFORM PR
[5]  
[Anonymous], 2014, P 2 INT C LEARNING R
[6]  
[Anonymous], 2012, P 2012 SIAM INT C DA
[7]   The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances [J].
Bagnall, Anthony ;
Lines, Jason ;
Bostrom, Aaron ;
Large, James ;
Keogh, Eamonn .
DATA MINING AND KNOWLEDGE DISCOVERY, 2017, 31 (03) :606-660
[8]   Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles [J].
Bagnall, Anthony ;
Lines, Jason ;
Hills, Jon ;
Bostrom, Aaron .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (09) :2522-2535
[9]   A Bag-of-Features Framework to Classify Time Series [J].
Baydogan, Mustafa Gokce ;
Runger, George ;
Tuv, Eugene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2796-2802
[10]  
Clevert Djork-Arne, 2015, 4 INT C LEARN REPR I