First Error-Based Supervised Learning Algorithm for Spiking Neural Networks

被引:13
作者
Luo, Xiaoling [1 ]
Qu, Hong [1 ]
Zhang, Yun [1 ]
Chen, Yi [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Sichuan, Peoples R China
基金
美国国家科学基金会;
关键词
spike neural networks; supervised learning; synaptic plasticity; first error learning; speech recognition; PERCEPTRON; PRECISION; CORTEX; RESUME; TRAINS;
D O I
10.3389/fnins.2019.00559
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Neural circuits respond to multiple sensory stimuli by firing precisely timed spikes. Inspired by this phenomenon, the spike timing-based spiking neural networks (SNNs) are proposed to process and memorize the spatiotemporal spike patterns. However, the response speed and accuracy of the existing learning algorithms of SNNs are still lacking compared to the human brain. To further improve the performance of learning precisely timed spikes, we propose a new weight updating mechanism which always adjusts the synaptic weights at the first wrong output spike time. The proposed learning algorithm can accurately adjust the synaptic weights that contribute to the membrane potential of desired and non-desired firing time. Experimental results demonstrate that the proposed algorithm shows higher accuracy, better robustness, and less computational resources compared with the remote supervised method (ReSuMe) and the spike pattern association neuron (SPAN), which are classic sequence learning algorithms. In addition, the SNN-based computational model equipped with the proposed learning method achieves better recognition results in speech recognition task compared with other bio-inspired baseline systems.
引用
收藏
页数:14
相关论文
共 58 条
  • [1] Abdollahi M, 2011, BIOMED CIRC SYST C, P269, DOI 10.1109/BioCAS.2011.6107779
  • [2] [Anonymous], 2018, P IEEE INT JOINT C N
  • [3] Temporal precision of spike trains in extrastriate cortex of the behaving macaque monkey
    Bair, W
    Koch, C
    [J]. NEURAL COMPUTATION, 1996, 8 (06) : 1185 - 1202
  • [4] Canonical Microcircuits for Predictive Coding
    Bastos, Andre M.
    Usrey, W. Martin
    Adams, Rick A.
    Mangun, George R.
    Fries, Pascal
    Friston, Karl J.
    [J]. NEURON, 2012, 76 (04) : 695 - 711
  • [5] Berry MJ, 1998, ADV NEUR IN, V10, P110
  • [6] Error-backpropagation in temporally encoded networks of spiking neurons
    Bohte, SM
    Kok, JN
    La Poutré, H
    [J]. NEUROCOMPUTING, 2002, 48 : 17 - 37
  • [7] Temporal codes and computations for sensory representation and scene analysis
    Cariani, PA
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (05): : 1100 - 1111
  • [8] NAVIS: Neuromorphic Auditory VISualizer Tool
    Dominguez-Morales, Juan P.
    Jimenez-Fernandez, A.
    Dominguez-Morales, M.
    Jimenez-Moreno, G.
    [J]. NEUROCOMPUTING, 2017, 237 : 418 - 422
  • [9] The Chronotron: A Neuron That Learns to Fire Temporally Precise Spike Patterns
    Florian, Razvan V.
    [J]. PLOS ONE, 2012, 7 (08):
  • [10] Rate coding versus temporal order coding: a theoretical approach
    Gautrais, J
    Thorpe, S
    [J]. BIOSYSTEMS, 1998, 48 (1-3) : 57 - 65