Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator

被引:177
作者
Neil, Daniel [1 ]
Liu, Shih-Chii [1 ]
机构
[1] Univ Zurich, ETH Zurich, Inst Neuroinformat, CH-8057 Zurich, Switzerland
关键词
Deep belief networks; field programmable arrays; machine learning; neural networks; restricted Boltzmann machines; spiking neural networks; NEURAL-NETWORKS; SIMULATION; HARDWARE;
D O I
10.1109/TVLSI.2013.2294916
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Current neural networks are accumulating accolades for their performance on a variety of real-world computational tasks including recognition, classification, regression, and prediction, yet there are few scalable architectures that have emerged to address the challenges posed by their computation. This paper introduces Minitaur, an event-driven neural network accelerator, which is designed for low power and high performance. As an field-programmable gate array-based system, it can be integrated into existing robotics or it can offload computationally expensive neural network tasks from the CPU. The version presented here implements a spiking deep network which achieves 19 million postsynaptic currents per second on 1.5 W of power and supports up to 65 K neurons per board. The system records 92% accuracy on the MNIST handwritten digit classification and 71% accuracy on the 20 newsgroups classification data set. Due to its event-driven nature, it allows for trading off between accuracy and latency.
引用
收藏
页码:2621 / 2628
页数:8
相关论文
共 28 条
  • [1] Hardware event-driven simulation engine for spiking neural networks
    Agis, R.
    Ros, E.
    Diaz, J.
    Carrillo, R.
    Ortigosa, E. M.
    [J]. INTERNATIONAL JOURNAL OF ELECTRONICS, 2007, 94 (05) : 469 - 480
  • [2] [Anonymous], 2013, FRONTIERS NEUROSCIEN
  • [3] Simulation of networks of spiking neurons:: A review of tools and strategies
    Brette, Romain
    Rudolph, Michelle
    Carnevale, Ted
    Hines, Michael
    Beeman, David
    Bower, James M.
    Diesmann, Markus
    Morrison, Abigail
    Goodman, Philip H.
    Harris, Frederick C., Jr.
    Zirpe, Milind
    Natschlaeger, Thomas
    Pecevski, Dejan
    Ermentrout, Bard
    Djurfeldt, Mikael
    Lansner, Anders
    Rochel, Olivier
    Vieville, Thierry
    Muller, Eilif
    Davison, Andrew P.
    El Boustani, Sami
    Destexhe, Alain
    [J]. JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2007, 23 (03) : 349 - 398
  • [4] Lapicque's 1907 paper: from frogs to integrate-and-fire
    Brunel, Nicolas
    van Rossum, Mark C. W.
    [J]. BIOLOGICAL CYBERNETICS, 2007, 97 (5-6) : 337 - 339
  • [5] Cassidy A., 2011, 2011 45th Annual Conference on Information Sciences and Systems, P1, DOI DOI 10.1109/CISS.2011.5766099
  • [6] Cheung Kit, 2012, Artificial Neural Networks and Machine Learning - ICANN 2012. Proceedings of the 22nd International Conference on Artificial Neural Networks, P113, DOI 10.1007/978-3-642-33269-2_15
  • [7] Deep, Big, Simple Neural Nets for Handwritten Digit Recognition
    Ciresan, Dan Claudiu
    Meier, Ueli
    Gambardella, Luca Maria
    Schmidhuber, Juergen
    [J]. NEURAL COMPUTATION, 2010, 22 (12) : 3207 - 3220
  • [8] Delbruck T., 2008, P INT S SECURE LIF, P21
  • [9] SpikeNET: an event-driven simulation package for modelling large networks of spiking neurons
    Delorme, A
    Thorpe, SJ
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2003, 14 (04) : 613 - 627
  • [10] Farabet C., 2011, LARGE SCALE FPGA BAS