Efficient design of hardware-enabled reservoir computing in FPGAs

被引:27
作者
Penkovsky, Bogdan [1 ]
Larger, Laurent [1 ]
Brunner, Daniel [1 ]
机构
[1] Univ Bourgogne Franche Comte, UMR CNRS 6174, FEMTO ST Opt Dept, 15B Ave Montboucons, F-25030 Besancon, France
关键词
SYSTEMS; COMPLEX;
D O I
10.1063/1.5039826
中图分类号
O59 [应用物理学];
学科分类号
摘要
In this work, we propose a new approach toward the efficient optimization and implementation of reservoir computing hardware, reducing the required domain-expert knowledge and optimization effort. First, we introduce a self-adapting reservoir input mask to the structure of the data via linear autoencoders. We, therefore, incorporate the advantages of dimensionality reduction and dimensionality expansion achieved by conventional algorithmically-efficient linear algebra procedures of principal component analysis. Second, we employ evolutionary-inspired genetic algorithm techniques resulting in a highly efficient optimization of reservoir dynamics with a dramatically reduced number of evaluations comparing to exhaustive search. We illustrate the method on the so-called single-node reservoir computing architecture, especially suitable for implementation in ultrahighspeed hardware. The combination of both methods and the resulting reduction of time required for performance optimization of a hardware system establish a strategy toward machine learning hardware capable of self-adaption to optimally solve specific problems. We confirm the validity of those principles building reservoir computing hardware based on a field-programmable gate array. Published by AIP Publishing.
引用
收藏
页数:9
相关论文
共 45 条
[11]  
Canaday D., 2018, ARXIV180707627
[12]   An introduction to genetic algorithms [J].
Deb, K .
SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 1999, 24 (4-5) :293-315
[13]   All-optical reservoir computing [J].
Duport, Francois ;
Schneider, Bendix ;
Smerieri, Anteo ;
Haelterman, Marc ;
Massar, Serge .
OPTICS EXPRESS, 2012, 20 (20) :22783-22795
[14]  
Fernando C, 2003, LECT NOTES ARTIF INT, V2801, P588
[15]  
Ferreira Aida A., 2009, Proceedings 2009 International Joint Conference on Neural Networks (IJCNN 2009 - Atlanta), P811, DOI 10.1109/IJCNN.2009.5178654
[16]  
Graves A, 2013, INT CONF ACOUST SPEE, P6645, DOI 10.1109/ICASSP.2013.6638947
[17]   Optoelectronic Systems Trained With Backpropagation Through Time [J].
Hermans, Michiel ;
Dambre, Joni ;
Bienstman, Peter .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (07) :1545-1550
[18]   Recurrent Kernel Machines: Computing with Infinite Echo State Networks [J].
Hermans, Michiel ;
Schrauwen, Benjamin .
NEURAL COMPUTATION, 2012, 24 (01) :104-133
[19]  
Holland J. H., 1975, Adaptation in Natural and Artificial Systems
[20]   Analysis of a complex of statistical variables into principal components [J].
Hotelling, H .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 1933, 24 :417-441