Temporal pattern identification using spike-timing dependent plasticity

被引:7
作者
Henry, Frederic
Daucé, Emmanuel
Soula, Hedi
机构
[1] Univ Mediterranean, Fac Sport Sci, UMR6152, F-13288 Marseille 9, France
[2] Ecole Cent Marseille, F-13451 Marseille 20, France
[3] Inst Natl Sci Appl, F-69621 Villeurbanne, France
关键词
synaptic plasticity; spike-timing dependent plasticity; random recurrent neural network; dynamics reduction; reinforcement learning;
D O I
10.1016/j.neucom.2006.10.082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the question of the functional role of the dual application of positive and negative Hebbian time dependent plasticity rules, in the particular framework of reinforcement learning tasks. Our simulations take place in a recurrent network of spiking neurons with inhomogeneous synaptic weights. A spike-timing dependent plasticity (STDP) rule is combined with its "opposite", the "anti-STDP". A local regulation mechanism moreover maintains the postsynaptic neuron in the vicinity of a reference frequency, which forces the global dynamics to be maintained in a softly disordered regime. This approach is tested on a simple discrimination task which requires short-term memory: temporal pattern classification. We show that such temporal patterns can be categorised, and present tracks for future improvements. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:2009 / 2016
页数:8
相关论文
共 16 条
[1]  
BARTLETT PL, 1999, HEBBIAN SYNAPTIC MOD
[2]   Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type [J].
Bi, GQ ;
Poo, MM .
JOURNAL OF NEUROSCIENCE, 1998, 18 (24) :10464-10472
[3]   LONG-LASTING POTENTIATION OF SYNAPTIC TRANSMISSION IN DENTATE AREA OF ANESTHETIZED RABBIT FOLLOWING STIMULATION OF PERFORANT PATH [J].
BLISS, TVP ;
LOMO, T .
JOURNAL OF PHYSIOLOGY-LONDON, 1973, 232 (02) :331-356
[4]   Operant conditioning in invertebrates [J].
Brembs, B .
CURRENT OPINION IN NEUROBIOLOGY, 2003, 13 (06) :710-717
[5]   Evolving spike-timing-dependent plasticity for single-trial learning in robots [J].
Di Paolo, EA .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2003, 361 (1811) :2299-2319
[6]   Evolutionary robots with on-line self-organization and behavioral fitness [J].
Floreano, D ;
Urzelai, J .
NEURAL NETWORKS, 2000, 13 (4-5) :431-443
[7]  
JAEGER H, 2002, ADAPTIVE NONLINEAR S
[8]   Actor-critic models of the basal ganglia: new anatomical and computational perspectives [J].
Joel, D ;
Niv, Y ;
Ruppin, E .
NEURAL NETWORKS, 2002, 15 (4-6) :535-547
[9]   Real-time computing without stable states:: A new framework for neural computation based on perturbations [J].
Maass, W ;
Natschläger, T ;
Markram, H .
NEURAL COMPUTATION, 2002, 14 (11) :2531-2560
[10]  
PENN A, 2002, 5 GERM WORKSH ART LI