Reservoir Computing Approaches for Representation and Classification of Multivariate Time Series

被引:122
作者
Bianchi, Filippo Maria [1 ,2 ]
Scardapane, Simone [3 ]
Lokse, Sigurd [1 ]
Jenssen, Robert [1 ]
机构
[1] UiT Arctic Univ Norway, Dept Phys & Technol, N-9019 Tromso, Norway
[2] NORCE Norwegian Res Ctr, N-5838 Bergen, Norway
[3] Sapienza Univ Rome, Dept Informat Engn Elect & Telecommun, I-00184 Rome, Italy
关键词
Reservoirs; Computational modeling; Predictive models; Time series analysis; Computer architecture; Decoding; Training; Model space; recurrent neural networks (RNNs); reservoir computing (RC); time series classification; ECHO STATE NETWORK;
D O I
10.1109/TNNLS.2020.3001377
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Classification of multivariate time series (MTS) has been tackled with a large variety of methodologies and applied to a wide range of scenarios. Reservoir computing (RC) provides efficient tools to generate a vectorial, fixed-size representation of the MTS that can be further processed by standard classifiers. Despite their unrivaled training speed, MTS classifiers based on a standard RC architecture fail to achieve the same accuracy of fully trainable neural networks. In this article, we introduce the reservoir model space, an unsupervised approach based on RC to learn vectorial representations of MTS. Each MTS is encoded within the parameters of a linear model trained to predict a low-dimensional embedding of the reservoir dynamics. Compared with other RC methods, our model space yields better representations and attains comparable computational performance due to an intermediate dimensionality reduction procedure. As a second contribution, we propose a modular RC framework for MTS classification, with an associated open-source Python library. The framework provides different modules to seamlessly implement advanced RC architectures. The architectures are compared with other MTS classifiers, including deep learning models and time series kernels. Results obtained on the benchmark and real-world MTS data sets show that RC classifiers are dramatically faster and, when implemented using our proposed representation, also achieve superior classification accuracy.
引用
收藏
页码:2169 / 2179
页数:11
相关论文
共 60 条
[1]  
[Anonymous], 2014, NeurIPS6
[2]  
[Anonymous], 2017, ARXIV170704035
[3]   Time Series Classification in Reservoir-and Model-Space: A Comparison [J].
Aswolinskiy, Witali ;
Reinhart, Rene Felix ;
Steil, Jochen .
ARTIFICIAL NEURAL NETWORKS IN PATTERN RECOGNITION, 2016, 9896 :197-208
[4]  
Babinec S, 2006, LECT NOTES COMPUT SC, V4131, P367
[5]   The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances [J].
Bagnall, Anthony ;
Lines, Jason ;
Bostrom, Aaron ;
Large, James ;
Keogh, Eamonn .
DATA MINING AND KNOWLEDGE DISCOVERY, 2017, 31 (03) :606-660
[6]   Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles [J].
Bagnall, Anthony ;
Lines, Jason ;
Hills, Jon ;
Bostrom, Aaron .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (09) :2522-2535
[7]   Time series representation and similarity based on local autopatterns [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2016, 30 (02) :476-509
[8]   Learning a symbolic representation for multivariate time series classification [J].
Baydogan, Mustafa Gokce ;
Runger, George .
DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (02) :400-422
[9]  
Bianchi F. M, 2018, P EUR S ART NEUR NET, P1
[10]   Learning representations of multivariate time series with missing data [J].
Bianchi, Filippo Maria ;
Livi, Lorenzo ;
Mikalsen, Karl Oyvind ;
Kampffmeyer, Michael ;
Jenssen, Robert .
PATTERN RECOGNITION, 2019, 96