FPGA Implementation for Large Scale Reservoir Computing based on Chaotic Boltzmann Machine

被引:0
作者
Matsumoto, Shigeki [1 ]
Ichikawa, Yuki [1 ]
Kajihara, Nobuki [1 ]
Tamukoh, Hakaru [2 ]
机构
[1] IVIS Inc, Bunkyo ku, Tokyo, Japan
[2] Kyushu Inst Technol, Graduate Sch Life Sci & Syst Engn, Kitakyushu, Japan
来源
2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024 | 2024年
关键词
Neural networks; Reservoir Computing; FPGA; Chaotic Boltzmann Machine; Sparse Matrix Compression;
D O I
10.1109/ISCAS58744.2024.10558106
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper reports on a field programmable gate array (FPGA) implementation of Chaotic Boltzmann Machine Reservoir Computing (CBM-RC). The reservoir will be large-scale, as it is expected to be applied to sensor information prediction for autonomous mobile robots. Therefore, we employ a design premised on storing the weight information into a large memory outside the FPGA. We propose an efficient compression method for the weight matrix and a parallel processing system, by considering both the characteristics of CBM-RC and the fact that the weight matrix of a large-scale reservoir is generally a sparse matrix. Our RC system, which has more than 8000 neurons and 1024 inputs/outputs, has been implemented on an AMD Alveo U50 FPGA board. This RC is the largest scale compared to those in related studies. We have performed the NARMA10 task and demonstrated that we can estimate 1024 predictions at once with NMSE accuracy that is even or better to conventional RC.
引用
收藏
页数:5
相关论文
共 50 条
[21]   The Design and FPGA-Based Implementation of a Stream Cipher Based on a Secure Chaotic Generator [J].
Dridi, Fethi ;
El Assad, Safwan ;
El Hadj Youssef, Wajih ;
Machhout, Mohsen ;
Lozi, Rene .
APPLIED SCIENCES-BASEL, 2021, 11 (02) :1-19
[22]   Low Power Implementation of FSM Based Vending Machine on FPGA [J].
Verrna, Gaurav ;
Maheshwari, Shikhar ;
Papreja, Ashish ;
Virdi, Sukhbani Kaur ;
Shekhar, Sushant .
PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, :2054-2058
[23]   FPGA Hardware Implementation and Optimization for Neural Network based Chaotic System Design [J].
Schmitz, Jesse ;
Zhang, Lei .
HEART 2018: PROCEEDINGS OF THE 9TH INTERNATIONAL SYMPOSIUM ON HIGHLY-EFFICIENT ACCELERATORS AND RECONFIGURABLE TECHNOLOGIES, 2018,
[24]   Design and Implementation Based on FPGA of a Group of Three-dimension Chaotic System [J].
Wang, Z. -L. ;
Chen, Z-Q .
2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, :70-74
[25]   Hardware design and implementation of a novel ANN-based chaotic generator in FPGA [J].
Alcin, Murat ;
Pehlivan, Ihsan ;
Koyuncu, Ismail .
OPTIK, 2016, 127 (13) :5500-5505
[26]   Molecular Simulations Using Boltzmann's Thermally Activated Diffusion - Implementation on ARUZ - Massively-parallel FPGA-based Machine [J].
Jablonski, Grzegorz ;
Amrozik, Piotr ;
Halagan, Krzysztof .
PROCEEDINGS OF THE 28TH INTERNATIONAL CONFERENCE MIXED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS (MIXDES 2021), 2021, :128-131
[27]   A Hybrid GPU-FPGA-based Computing Platform for Machine Learning [J].
Liu, Xu ;
Ounifi, Hibat Allah ;
Gherbi, Abdelouahed ;
Lemieux, Yves ;
Li, Wubin .
9TH INTERNATIONAL CONFERENCE ON EMERGING UBIQUITOUS SYSTEMS AND PERVASIVE NETWORKS (EUSPN-2018) / 8TH INTERNATIONAL CONFERENCE ON CURRENT AND FUTURE TRENDS OF INFORMATION AND COMMUNICATION TECHNOLOGIES IN HEALTHCARE (ICTH-2018), 2018, 141 :104-111
[28]   A novel approach for the implementation of large scale spiking neural networks on FPGA hardware [J].
Glackin, B ;
McGinnity, TM ;
Maguire, LP ;
Wu, Q ;
Belatreche, A .
COMPUTATIONAL INTELLIGENCE AND BIOINSPIRED SYSTEMS, PROCEEDINGS, 2005, 3512 :552-563
[29]   Implementation of reservoir computing using volatile WOx-based memristor [J].
Kim, Dahye ;
Shin, Jiwoong ;
Kim, Sungjun .
APPLIED SURFACE SCIENCE, 2022, 599
[30]   Implementation of a Pipeline Large-FFT Processor Based on the FPGA [J].
Ma, Yongkui ;
Liang, Henghao .
COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2019, 463 :638-644