Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator

被引:177
作者
Neil, Daniel [1 ]
Liu, Shih-Chii [1 ]
机构
[1] Univ Zurich, ETH Zurich, Inst Neuroinformat, CH-8057 Zurich, Switzerland
关键词
Deep belief networks; field programmable arrays; machine learning; neural networks; restricted Boltzmann machines; spiking neural networks; NEURAL-NETWORKS; SIMULATION; HARDWARE;
D O I
10.1109/TVLSI.2013.2294916
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Current neural networks are accumulating accolades for their performance on a variety of real-world computational tasks including recognition, classification, regression, and prediction, yet there are few scalable architectures that have emerged to address the challenges posed by their computation. This paper introduces Minitaur, an event-driven neural network accelerator, which is designed for low power and high performance. As an field-programmable gate array-based system, it can be integrated into existing robotics or it can offload computationally expensive neural network tasks from the CPU. The version presented here implements a spiking deep network which achieves 19 million postsynaptic currents per second on 1.5 W of power and supports up to 65 K neurons per board. The system records 92% accuracy on the MNIST handwritten digit classification and 71% accuracy on the 20 newsgroups classification data set. Due to its event-driven nature, it allows for trading off between accuracy and latency.
引用
收藏
页码:2621 / 2628
页数:8
相关论文
共 28 条
  • [11] Reducing the dimensionality of data with neural networks
    Hinton, G. E.
    Salakhutdinov, R. R.
    [J]. SCIENCE, 2006, 313 (5786) : 504 - 507
  • [12] Hinton G. E., 2012, THESIS U TORONTO TOR
  • [13] Simple model of spiking neurons
    Izhikevich, EM
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (06): : 1569 - 1572
  • [14] Kit Cheung, 2009, Proceedings of the 2009 International Conference on Field-Programmable Technology (FPT 2009), P247, DOI 10.1109/FPT.2009.5377667
  • [15] Lang K., 1995, Machine Learning. Proceedings of the Twelfth International Conference on Machine Learning, P331
  • [16] Gradient-based learning applied to document recognition
    Lecun, Y
    Bottou, L
    Bengio, Y
    Haffner, P
    [J]. PROCEEDINGS OF THE IEEE, 1998, 86 (11) : 2278 - 2324
  • [17] TOWARDS AN "EARLY NEURAL CIRCUIT SIMULATOR": A FPGA IMPLEMENTATION OF PROCESSING IN THE RAT WHISKER SYSTEM
    Leung, Brian
    Pan, Yan
    Schroeder, Chris
    Memik, Seda Ogrenci
    Memik, Gokhan
    Hartmann, Mitra J. Z.
    [J]. 2008 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE AND LOGIC APPLICATIONS, VOLS 1 AND 2, 2008, : 191 - +
  • [18] A 128x128 120 dB 15 μs latency asynchronous temporal contrast vision sensor
    Lichtsteiner, Patrick
    Posch, Christoph
    Delbruck, Tobi
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2008, 43 (02) : 566 - 576
  • [19] Liu SC, 2010, IEEE INT SYMP CIRC S, P2027, DOI 10.1109/ISCAS.2010.5537164
  • [20] Neuromorphic sensory systems
    Liu, Shih-Chii
    Delbruck, Tobi
    [J]. CURRENT OPINION IN NEUROBIOLOGY, 2010, 20 (03) : 288 - 295