An approach to reservoir computing design and training

被引:56
作者
Ferreira, Aida A. [1 ,2 ]
Ludermir, Teresa B. [1 ]
de Aquino, Ronaldo R. B. [1 ]
机构
[1] Fed Univ Pernambuco UFPE, BR-50740530 Recife, PE, Brazil
[2] Fed Inst Sci Technol & Educ Pernambuco, BR-50740530 Recife, PE, Brazil
关键词
Reservoir computing; Echo state networks; Evolutionary algorithm;
D O I
10.1016/j.eswa.2013.01.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reservoir computing is a framework for computation like a recurrent neural network that allows for the black box modeling of dynamical systems. In contrast to other recurrent neural network approaches, reservoir computing does not train the input and internal weights of the network, only the readout is trained. However it is necessary to adjust parameters to create a "good" reservoir for a given application. In this study we introduce a method, called RCDESIGN (reservoir computing and design training). RCDESIGN combines an evolutionary algorithm with reservoir computing and simultaneously looks for the best values of parameters, topology and weight matrices without rescaling the reservoir matrix by the spectral radius. The idea of adjust the spectral radius within the unit circle in the complex plane comes from the linear system theory. However, this argument does not necessarily apply to nonlinear systems, which is the case of reservoir computing. The results obtained with the proposed method are compared with results obtained by a genetic algorithm search for global parameters generation of reservoir computing. Four time series were used to validate RCDESIGN. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:4172 / 4182
页数:11
相关论文
共 28 条
[1]  
ANDERSON E., 1999, LAPACK USERSGUIDE, V3rd
[2]   Event detection and localization for small mobile robots using reservoir computing [J].
Antonelo, E. A. ;
Schrauwen, B. ;
Stroobandt, D. .
NEURAL NETWORKS, 2008, 21 (06) :862-871
[3]  
Aquino R. R. B., 2010, P INT JOINT C NEUR N, P3439
[4]  
Baker JE, 1987, P 2 INT C GEN ALG, V206, P14, DOI DOI 10.1007/S10489-006-0018-Y
[5]  
Bush K., 2005, P ART NEUR NETW ENG, P227
[6]  
DOMINEY PF, 1995, BIOL CYBERN, V73, P265, DOI 10.1007/BF00201428
[7]  
Ferreira A., 2008, P INT JOINT C NEUR N, P1950
[8]  
Ferreira Aida A., 2009, Proceedings 2009 International Joint Conference on Neural Networks (IJCNN 2009 - Atlanta), P811, DOI 10.1109/IJCNN.2009.5178654
[9]  
Ferreira Aida A., 2008, 2008 8th International Conference on Hybrid Intelligent Systems (HIS), P602, DOI 10.1109/HIS.2008.61
[10]  
Ferreira A. A., 2010, P INT JOINT C NEUR N, P1870