A Spiking Neural Network System for Robust Sequence Recognition

被引:68
作者
Yu, Qiang [1 ]
Yan, Rui [2 ]
Tang, Huajin [2 ]
Tan, Kay Chen [3 ]
Li, Haizhou [4 ]
机构
[1] Max Planck Inst Expt Med, Ctr Theoret Neurosci, Hermann Rein Str 3, D-37075 Gottingen, Germany
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
[3] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119260, Singapore
[4] Agcy Sci Technol & Res, Inst Infocomm Res, Singapore 138632, Singapore
关键词
Encoding; pattern recognition; sequence recognition; spiking neural networks (SNNs); temporal learning; TEMPORAL PRECISION; VISUAL INFORMATION; TRAINING ALGORITHM; NEURONS; CLASSIFICATION; DEPENDENCE; CORTEX; STATES; PHASE; MODEL;
D O I
10.1109/TNNLS.2015.2416771
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a biologically plausible network architecture with spiking neurons for sequence recognition. This architecture is a unified and consistent system with functional parts of sensory encoding, learning, and decoding. This is the first systematic model attempting to reveal the neural mechanisms considering both the upstream and the downstream neurons together. The whole system is a consistent temporal framework, where the precise timing of spikes is employed for information processing and cognitive computing. Experimental results show that the system is competent to perform the sequence recognition, being robust to noisy sensory inputs and invariant to changes in the intervals between input stimuli within a certain range. The classification ability of the temporal learning rule used in the system is investigated through two benchmark tasks that outperform the other two widely used learning rules for classification. The results also demonstrate the computational power of spiking neurons over perceptrons for processing spatiotemporal patterns. In summary, the system provides a general way with spiking neurons to encode external stimuli into spatiotemporal spikes, to learn the encoded spike patterns with temporal learning rules, and to decode the sequence order with downstream neurons. The system structure would be beneficial for developments in both hardware and software.
引用
收藏
页码:621 / 635
页数:15
相关论文
共 53 条
[1]   Stimulus dependence of two-state fluctuations of membrane potential in cat visual cortex [J].
Anderson, J ;
Lampl, I ;
Reichova, I ;
Carandini, M ;
Ferster, D .
NATURE NEUROSCIENCE, 2000, 3 (06) :617-621
[2]  
[Anonymous], 2000, PRINCIPLES NEURAL SC, DOI DOI 10.1007/SPRINGERREFERENCE_183113
[3]   Temporal precision of spike trains in extrastriate cortex of the behaving macaque monkey [J].
Bair, W ;
Koch, C .
NEURAL COMPUTATION, 1996, 8 (06) :1185-1202
[4]   Error-backpropagation in temporally encoded networks of spiking neurons [J].
Bohte, SM ;
Kok, JN ;
La Poutré, H .
NEUROCOMPUTING, 2002, 48 :17-37
[5]   Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks [J].
Bohte, SM ;
La Poutré, H ;
Kok, JN .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02) :426-435
[6]   Self-projection and the brain [J].
Buckner, Randy L. ;
Carroll, Daniel C. .
TRENDS IN COGNITIVE SCIENCES, 2007, 11 (02) :49-57
[7]  
Butts DA, 2007, NATURE, V449, P92, DOI [10.1038/nature06105, 10.1038/natureO6105]
[8]   Learning a Sparse Code for Temporal Sequences Using STDP and Sequence Compression [J].
Byrnes, Sean ;
Burkitt, Anthony N. ;
Grayden, David B. ;
Meffin, Hamish .
NEURAL COMPUTATION, 2011, 23 (10) :2567-2598
[9]  
Dennis J, 2013, INT CONF ACOUST SPEE, P803, DOI 10.1109/ICASSP.2013.6637759
[10]   The Spike-Timing Dependence of Plasticity [J].
Feldman, Daniel E. .
NEURON, 2012, 75 (04) :556-571