DFR: An Energy-efficient Analog Delay Feedback Reservoir Computing System for Brain-inspired Computing

被引:29
作者
Bai, Kangjun [1 ]
Yi, Yang [1 ]
机构
[1] Virginia Polytech Inst & State Univ, Virginia Tech, Bradley Dept Elect & Comp Engn ECE, 302 Whittemore,0111,1185 Perry St, Blacksburg, VA 24061 USA
关键词
Reservoir computing; brain-inspired computing; spiking neural network; edge of chaos regime; delayed feedback system; analog integrated circuit design; IMPLEMENTATION; RECOGNITION; CIRCUIT; NETWORK; CHAOS;
D O I
10.1145/3264659
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neuromorphic computing, which is built on a brain-inspired silicon chip, is uniquely applied to keep pace with the explosive escalation of algorithms and data density on machine learning. Reservoir computing, an emerging computing paradigm based on the recurrent neural network with proven benefits across multifaceted applications, offers an alternative training mechanism only at the readout stage. In this work, we successfully design and fabricate an energy-efficient analog delayed feedback reservoir (DFR) computing system, which is built upon a temporal encoding scheme, a nonlinear transfer function, and a dynamic delayed feedback loop. Measurement results demonstrate its high energy efficiency with rich dynamic behaviors, making the designed system a candidate for low power embedded applications. The system performance, as well as the robustness, are studied and analyzed through the Monte Carlo simulation. The chaotic time series prediction benchmark, NARMA10, is examined through the proposed DFR computing system, and exhibits a 36%-85% reduction on the error rate compared to state-of-the-art DFR computing system designs. To the best of our knowledge, our work represents the first analog integrated circuit (IC) implementation of the DFR computing system.
引用
收藏
页数:22
相关论文
共 73 条
[1]  
Alalshekmubarak Abdulrahman, 2014, Artificial Neural Networks and Machine Learning - ICANN 2014. 24th International Conference on Artificial Neural Networks. Proceedings: LNCS 8681, P225, DOI 10.1007/978-3-319-11179-7_29
[2]   FPGA-Based Stochastic Echo State Networks for Time-Series Forecasting [J].
Alomar, Miquel L. ;
Canals, Vincent ;
Perez-Mora, Nicolas ;
Martinez-Moll, Victor ;
Rossello, Josep L. .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2016, 2016
[3]   Exact Discrete-Time Implementation of the Mackey-Glass Delayed Model [J].
Amil, Pablo ;
Cabeza, Cecilia ;
Marti, Arturo C. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2015, 62 (07) :681-685
[4]  
[Anonymous], P 3 ACM INT C NAN CO
[5]  
[Anonymous], 2007, New directions in statistical signal processing: From systems to brain
[6]  
[Anonymous], 2007, Scholarpedia, DOI DOI 10.4249/SCHOLARPEDIA.2330
[7]  
[Anonymous], 2006, PATTERN RECOGN
[8]  
[Anonymous], 2001, GERMAN NATL RES CTR
[9]  
[Anonymous], 2001, SHORT TERM MEMORY EC
[10]  
[Anonymous], 2010, ADV SPEECH RECOGNITI