Delay-Based Reservoir Computing: Noise Effects in a Combined Analog and Digital Implementation

被引:128
作者
Soriano, Miguel C. [1 ]
Ortin, Silvia [2 ]
Keuninckx, Lars [3 ]
Appeltant, Lennert [3 ]
Danckaert, Jan [3 ]
Pesquera, Luis [2 ]
Van der Sande, Guy [3 ]
机构
[1] IFISC, E-07122 Palma De Mallorca, Spain
[2] IFCA, Inst Fis Cantabria, E-39005 Santander, Spain
[3] Vrije Univ Brussel, Appl Phys Res Grp, B-1050 Brussels, Belgium
关键词
Delay systems; dynamical systems; electronic circuits; memory capacity; pattern recognition; reservoir computing (RC); time-series prediction; NEURAL-NETWORKS;
D O I
10.1109/TNNLS.2014.2311855
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reservoir computing is a paradigm in machine learning whose processing capabilities rely on the dynamical behavior of recurrent neural networks. We present a mixed analog and digital implementation of this concept with a nonlinear analog electronic circuit as a main computational unit. In our approach, the reservoir network can be replaced by a single nonlinear element with delay via time-multiplexing. We analyze the influence of noise on the performance of the system for two benchmark tasks: 1) a classification problem and 2) a chaotic time-series prediction task. Special attention is given to the role of quantization noise, which is studied by varying the resolution in the conversion interface between the analog and digital worlds.
引用
收藏
页码:388 / 393
页数:6
相关论文
共 25 条
[1]  
[Anonymous], 1991, TEX INSTR DEV 46 WOR
[2]   Information processing using a single dynamical node as complex system [J].
Appeltant, L. ;
Soriano, M. C. ;
Van der Sande, G. ;
Danckaert, J. ;
Massar, S. ;
Dambre, J. ;
Schrauwen, B. ;
Mirasso, C. R. ;
Fischer, I. .
NATURE COMMUNICATIONS, 2011, 2
[3]   Parallel photonic information processing at gigabyte per second data rates using transient states [J].
Brunner, Daniel ;
Soriano, Miguel C. ;
Mirasso, Claudio R. ;
Fischer, Ingo .
NATURE COMMUNICATIONS, 2013, 4
[4]   Information Processing Capacity of Dynamical Systems [J].
Dambre, Joni ;
Verstraeten, David ;
Schrauwen, Benjamin ;
Massar, Serge .
SCIENTIFIC REPORTS, 2012, 2
[5]   All-optical reservoir computing [J].
Duport, Francois ;
Schneider, Bendix ;
Smerieri, Anteo ;
Haelterman, Marc ;
Massar, Serge .
OPTICS EXPRESS, 2012, 20 (20) :22783-22795
[6]   DIMENSIONS AND ENTROPIES OF CHAOTIC INTENSITY PULSATIONS IN A SINGLE-MODE FAR-INFRARED NH3 LASER [J].
HUBNER, U ;
ABRAHAM, NB ;
WEISS, CO .
PHYSICAL REVIEW A, 1989, 40 (11) :6354-6365
[7]  
Jaeger H., 2002, 152 GMD GERM NAT CTR
[8]  
Lakshmanan M, 2010, SPRINGER SER SYNERG, P1, DOI 10.1007/978-3-642-14938-2
[9]   Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing [J].
Larger, L. ;
Soriano, M. C. ;
Brunner, D. ;
Appeltant, L. ;
Gutierrez, J. M. ;
Pesquera, L. ;
Mirasso, C. R. ;
Fischer, I. .
OPTICS EXPRESS, 2012, 20 (03) :3241-3249
[10]   Reservoir Computing Trends [J].
Lukoševičius, Mantas ;
Jaeger, Herbert ;
Schrauwen, Benjamin .
KI - Kunstliche Intelligenz, 2012, 26 (04) :365-371