Supervised Learning of Logical Operations in Layered Spiking Neural Networks with Spike Train Encoding

被引:0
作者
André Grüning
Ioana Sporea
机构
[1] University of Surrey,Department of Computing
来源
Neural Processing Letters | 2012年 / 36卷
关键词
Spiking neural networks; Supervised learning; Logical operation; Spike trains;
D O I
暂无
中图分类号
学科分类号
摘要
Few algorithms for supervised training of spiking neural networks exist that can deal with patterns of multiple spikes, and their computational properties are largely unexplored. We demonstrate in a set of simulations that the ReSuMe learning algorithm can successfully be applied to layered neural networks. Input and output patterns are encoded as spike trains of multiple precisely timed spikes, and the network learns to transform the input trains into target output trains. This is done by combining the ReSuMe learning algorithm with multiplicative scaling of the connections of downstream neurons. We show in particular that layered networks with one hidden layer can learn the basic logical operations, including Exclusive-Or, while networks without hidden layer cannot, mirroring an analogous result for layered networks of rate neurons. While supervised learning in spiking neural networks is not yet fit for technical purposes, exploring computational properties of spiking neural networks advances our understanding of how computations can be done with spike trains.
引用
收藏
页码:117 / 134
页数:17
相关论文
共 59 条
[1]  
Bengio Y(1994)Learning long-term dependencies with gradient descent is difficult IEEE Trans Neural Netw 5 157-166
[2]  
Simard P(2000)Context-free and context-sensitive dynamics in recurrent neural networks Connect Sci 12 197-210
[3]  
Frasconi P(2002)Spike-prop: error-backpropagation in multi-layer networks of spiking neurons Neurocomputing 48 17-37
[4]  
Bodén M(2005)A gradient descent rule for spiking neurons emitting multiple spikes Inf Process Lett 95 552-558
[5]  
Wiles J(2011)Repective field optimisation and supervision of a fuzzy spiking neural network Neural Netw 24 247-256
[6]  
Bohte S(2006)Stack- and queue-like dynamics in recurrent neural networks Connect Sci 18 23-42
[7]  
Kok J(2007)Solving the distal reward problem through linkage of STDP and Dopamine signalling Cereb Cortex 17 2443-2452
[8]  
Poutré HL(2006)Comparison of supervised learning methods for spike time coding in spiking neural networks Int J Appl Math Comput Sci 16 101-113
[9]  
Booij O(2000)Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials Neural Comput 12 385-405
[10]  
tat Nguyen H(2005)What can a neuron learn with spike-timing-dependent plasticity? Neural Comput 17 2337-2382