Efficient STDP Micro-Architecture for Silicon Spiking Neural Networks

被引:1
作者
Dytckov, Sergei [1 ]
Daneshtalab, Masoud [1 ,2 ]
Ebrahimi, Masoumeh [1 ,2 ]
Anwar, Hassan [3 ]
Plosila, Juha [1 ]
Tenhunen, Hannu [1 ,2 ]
机构
[1] Univ Turku, SF-20500 Turku, Finland
[2] KTH Royal Inst Technol, Stockholm, Sweden
[3] Ecole Polytech Montreal, Montreal, PQ, Canada
来源
2014 17TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD) | 2014年
关键词
Spiking Neural Network; Networks-on-Chip; STDP; Neuron Clustering; REINFORCEMENT; MODEL;
D O I
10.1109/DSD.2014.109
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Spiking neural networks (SNNs) are the closest approach to biological neurons in comparison with conventional artificial neural networks (ANN). SNNs are composed of neurons and synapses which are interconnected with a complex pattern. As communication in such massively parallel computational systems is getting critical, the network-on-chip (NoC) becomes a promising solution to provide a scalable and robust interconnection fabric. However, using NoC for large-scale SNNs arises a trade-off between scalability, throughput, neuron/router ratio (cluster size), and area overhead. In this paper, we tackle the trade-off using a clustering approach and try to optimize the synaptic resource utilization. An optimal cluster size can provide the lowest area overhead and power consumption. For the learning purposes, a phenomenon known as spike-timing-dependent plasticity (STDP) is utilized. The micro-architectures of the network, clusters, and the computational neurons are also described. The presented approach suggests a promising solution of integrating NoCs and STDP-based SNNs for the optimal performance based on the underlying application.
引用
收藏
页码:496 / 503
页数:8
相关论文
共 28 条
[1]  
[Anonymous], 2010 INT JOINT C NEU
[2]  
[Anonymous], 2010, Schol- arpedia 5.2. revision 142314, DOI DOI 10.4249/SCHOLARPEDIA.1362
[3]  
Anwar Hassan., 2014, Proceedings of International Workshop on Manycore Embedded Systems. ACM, New York, NY, USA, P64
[4]  
Arthur J., 2006, ADV NEURAL INFORM PR, P75
[5]  
Carrillo S., 2012, 2012 Sixth IEEE/ACM International Symposium on Networks-on-Chip (NoCS), P83, DOI 10.1109/NOCS.2012.17
[6]   Advancing interconnect density for spiking neural network hardware implementations using traffic-aware adaptive network-on-chip routers [J].
Carrillo, Snaider ;
Harkin, Jim ;
McDaid, Liam ;
Pande, Sandeep ;
Cawley, Seamus ;
McGinley, Brian ;
Morgan, Fearghal .
NEURAL NETWORKS, 2012, 33 :42-57
[7]  
Choudhary Swadesh, 2012, Artificial Neural Networks and Machine Learning - ICANN 2012. Proceedings of the 22nd International Conference on Artificial Neural Networks, P121, DOI 10.1007/978-3-642-33269-2_16
[8]   Interconnection system for the SpiNNaker biologically inspired multi-computer [J].
Dugan, Kier ;
Reeve, Jeff ;
Brown, Andrew ;
Furber, Steve .
IET COMPUTERS AND DIGITAL TECHNIQUES, 2013, 7 (03) :115-121
[9]   Connection-Centric Network for Spiking Neural Networks [J].
Emery, Robin ;
Yakovlev, Alex ;
Chester, Graeme .
2009 3RD ACM/IEEE INTERNATIONAL SYMPOSIUM ON NETWORKS-ON-CHIP, 2009, :144-152
[10]   Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity [J].
Florian, Razvan V. .
NEURAL COMPUTATION, 2007, 19 (06) :1468-1502