Learning Spatiotemporally Encoded Pattern Transformations in Structured Spiking Neural Networks

被引:35
作者
Gardner, Brian [1 ]
Sporea, Ioana [1 ]
Gruening, Andre [1 ]
机构
[1] Univ Surrey, Dept Comp Sci, Guildford GU2 7XH, Surrey, England
基金
英国工程与自然科学研究理事会;
关键词
TIMING-DEPENDENT PLASTICITY; ERROR-BACKPROPAGATION; REINFORCEMENT; NEURONS; REWARD; NOISE;
D O I
10.1162/NECO_a_00790
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Information encoding in the nervous system is supported through the precise spike timings of neurons; however, an understanding of the underlying processes by which such representations are formed in the first place remains an open question. Here we examine how multilayered networks of spiking neurons can learn to encode for input patterns using a fully temporal coding scheme. To this end, we introduce a new supervised learning rule, MultilayerSpiker, that can train spiking networks containing hidden layer neurons to perform transformations between spatiotemporal input and output spike patterns. The performance of the proposed learning rule is demonstrated in terms of the number of pattern mappings it can learn, the complexity of network structures it can be used on, and its classification accuracy when using multispike-based encodings. In particular, the learning rule displays robustness against input noise and can generalize well on an example data set. Our approach contributes to both a systematic understanding of how computations might take place in the nervous system and a learning rule that displays strong technical capability.
引用
收藏
页码:2548 / 2586
页数:39
相关论文
共 50 条
[1]  
Albers C., 2013, ADV NEURAL INFORM PR, P1709
[2]   Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type [J].
Bi, GQ ;
Poo, MM .
JOURNAL OF NEUROSCIENCE, 1998, 18 (24) :10464-10472
[3]   The evidence for neural information processing with precise spike-times: A survey [J].
Bohte S.M. .
Natural Computing, 2004, 3 (2) :195-206
[4]  
Bohte SM, 2011, LECT NOTES COMPUT SC, V6791, P60, DOI 10.1007/978-3-642-21735-7_8
[5]   Error-backpropagation in temporally encoded networks of spiking neurons [J].
Bohte, SM ;
Kok, JN ;
La Poutré, H .
NEUROCOMPUTING, 2002, 48 :17-37
[6]   Matching Recall and Storage in Sequence Learning with Spiking Neural Networks [J].
Brea, Johanni ;
Senn, Walter ;
Pfister, Jean-Pascal .
JOURNAL OF NEUROSCIENCE, 2013, 33 (23) :9565-9575
[7]   Spike timing-dependent plasticity: A Hebbian learning rule [J].
Caporale, Natalia ;
Dan, Yang .
ANNUAL REVIEW OF NEUROSCIENCE, 2008, 31 :25-46
[8]   Primary cortical representation of sounds by the coordination of action-potential timing [J].
deCharms, RC ;
Merzenich, MM .
NATURE, 1996, 381 (6583) :610-613
[9]   Noise in the nervous system [J].
Faisal, A. Aldo ;
Selen, Luc P. J. ;
Wolpert, Daniel M. .
NATURE REVIEWS NEUROSCIENCE, 2008, 9 (04) :292-303
[10]   Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity [J].
Florian, Razvan V. .
NEURAL COMPUTATION, 2007, 19 (06) :1468-1502