Multi-scale Attention Convolutional Neural Network for time series classification

被引:138
作者
Chen, Wei [1 ]
Shi, Ke [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Time series classification; Convolutional neural network; Multi-scale attention mechanism;
D O I
10.1016/j.neunet.2021.01.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid increase of data availability, time series classification (TSC) has arisen in a wide range of fields and drawn great attention of researchers. Recently, hundreds of TSC approaches have been developed, which can be classified into two categories: traditional and deep learning based TSC methods. However, it remains challenging to improve accuracy and model generalization ability. Therefore, we investigate a novel end-to-end model based on deep learning named as Multi-scale Attention Convolutional Neural Network (MACNN) to solve the TSC problem. We first apply the multi scale convolution to capture different scales of information along the time axis by generating different scales of feature maps. Then an attention mechanism is proposed to enhance useful feature maps and suppress less useful ones by learning the importance of each feature map automatically. MACNN addresses the limitation of single-scale convolution and equal weight feature maps. We conduct a comprehensive evaluation of 85 UCR standard datasets and the experimental results show that our proposed approach achieves the best performance and outperforms the other traditional and deep learning based methods by a large margin. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:126 / 140
页数:15
相关论文
共 34 条
[1]   Time Series Classification in Reservoir- and Model-Space [J].
Aswolinskiy, Witali ;
Reinhart, Rene Felix ;
Steil, Jochen .
NEURAL PROCESSING LETTERS, 2018, 48 (02) :789-809
[2]   The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances [J].
Bagnall, Anthony ;
Lines, Jason ;
Bostrom, Aaron ;
Large, James ;
Keogh, Eamonn .
DATA MINING AND KNOWLEDGE DISCOVERY, 2017, 31 (03) :606-660
[3]   Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles [J].
Bagnall, Anthony ;
Lines, Jason ;
Hills, Jon ;
Bostrom, Aaron .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (09) :2522-2535
[4]   A Deep Transfer Learning Approach for Improved Post-Traumatic Stress Disorder Diagnosis [J].
Banerjee, Debrup ;
Islam, Kazi ;
Mei, Gang ;
Xiao, Lemin ;
Zhang, Guangfan ;
Xu, Roger ;
Ji, Shuiwang ;
Li, Jiang .
2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2017, :11-20
[5]   A Bag-of-Features Framework to Classify Time Series [J].
Baydogan, Mustafa Gokce ;
Runger, George ;
Tuv, Eugene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2796-2802
[6]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[7]   Deep learning for time series classification: a review [J].
Fawaz, Hassan Ismail ;
Forestier, Germain ;
Weber, Jonathan ;
Idoumghar, Lhassane ;
Muller, Pierre-Alain .
DATA MINING AND KNOWLEDGE DISCOVERY, 2019, 33 (04) :917-963
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   Classification of time series by shapelet transformation [J].
Hills, Jon ;
Lines, Jason ;
Baranauskas, Edgaras ;
Mapp, James ;
Bagnall, Anthony .
DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 28 (04) :851-881
[10]  
Hu J., 2019, PROC CVPR IEEE