Reservoir Computing for Scalable Hardware with Block-Based Neural Network

被引:1
作者
Lee, Kundo [1 ,2 ]
Hamagami, Tomoki [2 ]
机构
[1] Mentor Graph Japan Co Ltd, Shinagawa Ku, Gotenyama Trust Tower 7-35,Kita Shinagawa 4 Chome, Tokyo 1400001, Japan
[2] Yokohama Natl Univ, Grad Sch Engn Sci, 79-5 Tokiwadai, Yokohama, Kanagawa 2408501, Japan
关键词
reservoir computing; block-based neural networks; echo state networks; liquid state machines; FPGA;
D O I
10.1002/tee.23473
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a reservoir computing technique using Asynchronous Block-Based Neural Networks (ABBNN). Echo State Networks and Liquid State Machines introduced a new paradigm in artificial neural networks (ANN), known as Reservoir Computing (RC). A recurrent neural network (RNN) in Reservoir Computing is generated randomly, and only a readout is trained. The reservoir computing greatly facilitated the practical RNN application and outperformed classical RNN in many tasks. ABBNN is an extended version of the classical block-based neural network model. ABBNN, an evolvable neural network model, provides a model-free estimation of nonlinear dynamical systems. To propose a hardware-aware model of reservoir computing and high-speed training, we introduce Block-Based Reservoir Computing (BBRC). BBRC provides a flexible architecture. The architecture based on the basic blocks provides a regularity that supports scalable hardware. In contrast, BBRC also supports randomness based on the internal configuration. Both are significant features in achieving an optimal hardware reservoir computer. (c) 2021 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.
引用
收藏
页码:1594 / 1602
页数:9
相关论文
共 21 条
[1]   FPGA-Based Stochastic Echo State Networks for Time-Series Forecasting [J].
Alomar, Miquel L. ;
Canals, Vincent ;
Perez-Mora, Nicolas ;
Martinez-Moll, Victor ;
Rossello, Josep L. .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2016, 2016
[2]  
Andrews D.F., 1985, Data: A Collection of Problems from Many Fields for the Student and Research Worker
[3]  
[Anonymous], 2005, P 16 ANN PROR WORKSH
[4]   APPROXIMATION OF DYNAMICAL-SYSTEMS BY CONTINUOUS-TIME RECURRENT NEURAL NETWORKS [J].
FUNAHASHI, K ;
NAKAMURA, Y .
NEURAL NETWORKS, 1993, 6 (06) :801-806
[5]   A Stochastic Computational Approach for Accurate and Efficient Reliability Evaluation [J].
Han, Jie ;
Chen, Hao ;
Liang, Jinghang ;
Zhu, Peican ;
Yang, Zhixi ;
Lombardi, Fabrizio .
IEEE TRANSACTIONS ON COMPUTERS, 2014, 63 (06) :1336-1350
[6]  
Jaeger H., 2010, 148 GERM NAT RES CTR
[7]  
Kong SG, 2004, IEEE IJCNN, P1579
[8]  
Lee K., 2019, IEEJ T ELECT INFORM, V139, P1059, DOI [10.1541/ieejeiss.139.1059, DOI 10.1541/IEEJEISS.139.1059]
[9]   Introduction to Stochastic Computing using a Remote Lab with Reconfigurable Logic [J].
Lobo, Jorge .
INTERNATIONAL JOURNAL OF ONLINE ENGINEERING, 2016, 12 (04) :23-26
[10]   An FPGA Implementation of a Time Delay Reservoir Using Stochastic Logic [J].
Loomis, Lisa ;
McDonald, Nathan ;
Merkel, Cory .
ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2018, 14 (04)