Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

被引:444
作者
Ponulak, Filip [1 ,2 ]
Kasinski, Andrzej [1 ]
机构
[1] Poznan Univ Tech, Inst Control & Informat Engn, PL-60965 Poznan, Poland
[2] Univ Freiburg, Bernstein Ctr Computat Neurosci, D-79104 Freiburg, Germany
关键词
DEPENDENT SYNAPTIC PLASTICITY; INSTRUCTIVE SIGNALS; INTERNAL-MODELS; CEREBELLUM; MECHANISMS; PRECISION; NEURONS; PATHWAY;
D O I
10.1162/neco.2009.11-08-901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning from instructions or demonstrations is a fundamental property of our brain necessary to acquire new knowledge and develop novel skills or behavioral patterns. This type of learning is thought to be involved in most of our daily routines. Although the concept of instruction-based learning has been studied for several decades, the exact neural mechanisms implementing this process remain unrevealed. One of the central questions in this regard is, How do neurons learn to reproduce template signals (instructions) encoded in precisely timed sequences of spikes? Here we present a model of supervised learning for biologically plausible neurons that addresses this question. In a set of experiments, we demonstrate that our approach enables us to train spiking neurons to reproduce arbitrary template spike patterns in response to given synaptic stimuli even in the presence of various sources of noise. We show that the learning rule can also be used for decision-making tasks. Neurons can be trained to classify categories of input signals based on only a temporal configuration of spikes. The decision is communicated by emitting precisely timed spike trains associated with given input categories. Trained neurons can perform the classification task correctly even if stimuli and corresponding decision times are temporally separated and the relevant information is consequently highly overlapped by the ongoing neural activity. Finally, we demonstrate that neurons can be trained to reproduce sequences of spikes with a controllable time shift with respect to target templates. A reproduced signal can follow or even precede the targets. This surprising result points out that spiking neurons can potentially be applied to forecast the behavior (firing times) of other reference neurons or networks.
引用
收藏
页码:467 / 510
页数:44
相关论文
共 98 条
[1]  
[Anonymous], 2006, P EPFL LATSIS S 2006
[2]  
[Anonymous], 1973, Pattern Classification and Scene Analysis
[3]  
Belatreche A., 2003, Proc. IEEE Conf. Cybernetics Intelligence-Challenges and Advances, P39
[4]   Synaptic plasticity in a cerebellum-like structure depends on temporal order [J].
Bell, CC ;
Han, VZ ;
Sugawara, Y ;
Grant, K .
NATURE, 1997, 387 (6630) :278-281
[5]  
BELTER D, 2008, P REC ADV NEUR ROB S
[6]   The structure and precision of retinal spike trains [J].
Berry, MJ ;
Warland, DK ;
Meister, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1997, 94 (10) :5411-5416
[7]   Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms [J].
Bi, GQ .
BIOLOGICAL CYBERNETICS, 2002, 87 (5-6) :319-332
[8]   Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type [J].
Bi, GQ ;
Poo, MM .
JOURNAL OF NEUROSCIENCE, 1998, 18 (24) :10464-10472
[9]   Error-backpropagation in temporally encoded networks of spiking neurons [J].
Bohte, SM ;
Kok, JN ;
La Poutré, H .
NEUROCOMPUTING, 2002, 48 :17-37
[10]   A gradient descent rule for spiking neurons emitting multiple spikes [J].
Booij, O ;
Nguyen, HT .
INFORMATION PROCESSING LETTERS, 2005, 95 (06) :552-558