Efficient design of hardware-enabled reservoir computing in FPGAs

被引:27
作者
Penkovsky, Bogdan [1 ]
Larger, Laurent [1 ]
Brunner, Daniel [1 ]
机构
[1] Univ Bourgogne Franche Comte, UMR CNRS 6174, FEMTO ST Opt Dept, 15B Ave Montboucons, F-25030 Besancon, France
关键词
SYSTEMS; COMPLEX;
D O I
10.1063/1.5039826
中图分类号
O59 [应用物理学];
学科分类号
摘要
In this work, we propose a new approach toward the efficient optimization and implementation of reservoir computing hardware, reducing the required domain-expert knowledge and optimization effort. First, we introduce a self-adapting reservoir input mask to the structure of the data via linear autoencoders. We, therefore, incorporate the advantages of dimensionality reduction and dimensionality expansion achieved by conventional algorithmically-efficient linear algebra procedures of principal component analysis. Second, we employ evolutionary-inspired genetic algorithm techniques resulting in a highly efficient optimization of reservoir dynamics with a dramatically reduced number of evaluations comparing to exhaustive search. We illustrate the method on the so-called single-node reservoir computing architecture, especially suitable for implementation in ultrahighspeed hardware. The combination of both methods and the resulting reduction of time required for performance optimization of a hardware system establish a strategy toward machine learning hardware capable of self-adaption to optimally solve specific problems. We confirm the validity of those principles building reservoir computing hardware based on a field-programmable gate array. Published by AIP Publishing.
引用
收藏
页数:9
相关论文
共 45 条
[1]  
Amos B, 2016, CMUCS16118 CMU SCH C
[2]  
[Anonymous], 2017, CoRR
[3]  
[Anonymous], 2001, 14834 GMD
[4]  
[Anonymous], 1997, PSYCHOL LEARN MOTIV
[5]   Online Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalization [J].
Antonik, Piotr ;
Duport, Francois ;
Hermans, Michiel ;
Smerieri, Anteo ;
Haelterman, Marc ;
Massar, Serge .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) :2686-2698
[6]  
Aporntewan C., 2001, P 2001 C EV COMP SEO
[7]   Information processing using a single dynamical node as complex system [J].
Appeltant, L. ;
Soriano, M. C. ;
Van der Sande, G. ;
Danckaert, J. ;
Massar, S. ;
Dambre, J. ;
Schrauwen, B. ;
Mirasso, C. R. ;
Fischer, I. .
NATURE COMMUNICATIONS, 2011, 2
[8]   Photonic machine learning implementation for signal recovery in optical communications [J].
Argyris, Apostolos ;
Bueno, Julian ;
Fischer, Ingo .
SCIENTIFIC REPORTS, 2018, 8
[9]  
Bishop C.M., 2006, PATTERN RECOGN, V4, P738, DOI DOI 10.1117/1.2819119
[10]   Parallel photonic information processing at gigabyte per second data rates using transient states [J].
Brunner, Daniel ;
Soriano, Miguel C. ;
Mirasso, Claudio R. ;
Fischer, Ingo .
NATURE COMMUNICATIONS, 2013, 4