Error-backpropagation in temporally encoded networks of spiking neurons

被引:720
作者
Bohte, SM
Kok, JN
La Poutré, H
机构
[1] CWI, NL-1098 SJ Amsterdam, Netherlands
[2] Eindhoven Univ Technol, Sch Technol Management, NL-5600 MB Eindhoven, Netherlands
[3] Leiden Univ, LIACS, NL-2300 RA Leiden, Netherlands
关键词
spiking neurons; temporal coding; error-backpropagation;
D O I
10.1016/S0925-2312(01)00658-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For a network of spiking neurons that encodes information in the timing of individual spike times, we derive a supervised learning rule, SpikeProp, akin to traditional error-backpropagation. With this algorithm, we demonstrate how networks of spiking neurons with biologically reasonable action potentials can perform complex non-linear classification in fast temporal coding just as well as rate-coded networks. We perform experiments for the classical XOR problem, when posed in a temporal setting, as well as for a number of other benchmark datasets. Comparing the (implicit) number of spiking neurons required for the encoding of the interpolated XOR problem, the trained networks demonstrate that temporal coding is a viable code for fast neural information processing, and as such requires less neurons than instantaneous rate-coding. Furthermore, we find that reliable temporal computation in the spiking networks was only accomplished when using spike response functions with a time constant longer than the coding interval, as has been predicted by theoretical considerations. (C) 2002 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:17 / 37
页数:21
相关论文
共 52 条
[1]   SPATIOTEMPORAL FIRING PATTERNS IN THE FRONTAL-CORTEX OF BEHAVING MONKEYS [J].
ABELES, M ;
BERGMAN, H ;
MARGALIT, E ;
VAADIA, E .
JOURNAL OF NEUROPHYSIOLOGY, 1993, 70 (04) :1629-1638
[2]   Transformation from temporal to rate coding in a somatosensory thalamocortical pathway [J].
Ahissar, E ;
Sosnik, R ;
Haidarliu, S .
NATURE, 2000, 406 (6793) :302-306
[3]   Precisely correlated firing in cells of the lateral geniculate nucleus [J].
Alonso, JM ;
Usrey, WM ;
Reid, RC .
NATURE, 1996, 383 (6603) :815-819
[4]  
[Anonymous], PULSED NEURAL NETWOR
[5]   HOW SENSORY MAPS COULD ENHANCE RESOLUTION THROUGH ORDERED ARRANGEMENTS OF BROADLY TUNED RECEIVERS [J].
BALDI, P ;
HEILIGENBERG, W .
BIOLOGICAL CYBERNETICS, 1988, 59 (4-5) :313-318
[6]   Distributed synaptic modification in neural networks induced by patterned stimulation [J].
Bi, GQ ;
Poo, MM .
NATURE, 1999, 401 (6755) :792-796
[7]   READING A NEURAL CODE [J].
BIALEK, W ;
RIEKE, F ;
VANSTEVENINCK, RRD ;
WARLAND, D .
SCIENCE, 1991, 252 (5014) :1854-1857
[8]  
Bishop C. M., 1995, NEURAL NETWORKS PATT
[9]   Unsupervised classification of complex clusters in networks of spiking neurons [J].
Bohte, SM ;
Kok, JN ;
La Poutré, H .
IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL III, 2000, :279-284
[10]  
BRECHT M, 1998, P ENA 98