Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation

被引:34
作者
Luo, Xiaoling [1 ]
Qu, Hong [1 ]
Wang, Yuchen [1 ]
Yi, Zhang [2 ]
Zhang, Jilun [1 ]
Zhang, Malu [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
基金
美国国家科学基金会;
关键词
Neurons; Delays; Nonhomogeneous media; Membrane potentials; Heuristic algorithms; Biological system modeling; Backpropagation; spike neural networks; spike neurons; supervised learning; synaptic delay plasticity; SYNAPTIC DELAY; ALGORITHM; CLASSIFICATION; NEURONS; RESUME;
D O I
10.1109/TNNLS.2022.3164930
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The brain-inspired spiking neural networks (SNNs) hold the advantages of lower power consumption and powerful computing capability. However, the lack of effective learning algorithms has obstructed the theoretical advance and applications of SNNs. The majority of the existing learning algorithms for SNNs are based on the synaptic weight adjustment. However, neuroscience findings confirm that synaptic delays can also be modulated to play an important role in the learning process. Here, we propose a gradient descent-based learning algorithm for synaptic delays to enhance the sequential learning performance of single spiking neuron. Moreover, we extend the proposed method to multilayer SNNs with spike temporal-based error backpropagation. In the proposed multilayer learning algorithm, information is encoded in the relative timing of individual neuronal spikes, and learning is performed based on the exact derivatives of the postsynaptic spike times with respect to presynaptic spike times. Experimental results on both synthetic and realistic datasets show significant improvements in learning efficiency and accuracy over the existing spike temporal-based learning algorithms. We also evaluate the proposed learning method in an SNN-based multimodal computational model for audiovisual pattern recognition, and it achieves better performance compared with its counterparts.
引用
收藏
页码:10141 / 10153
页数:13
相关论文
共 50 条
  • [1] Supervised learning in multilayer spiking neural networks with inner products of spike trains
    Lin, Xianghong
    Wang, Xiangwen
    Hao, Zhanjun
    NEUROCOMPUTING, 2017, 237 : 59 - 70
  • [2] Supervised Learning With First-to-Spike Decoding in Multilayer Spiking Neural Networks
    Gardner, Brian
    Gruening, Andre
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2021, 15
  • [3] A Supervised Learning Algorithm for Learning Precise Timing of Multiple Spikes in Multilayer Spiking Neural Networks
    Taherkhani, Aboozar
    Belatreche, Ammar
    Li, Yuhua
    Maguire, Liam P.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5394 - 5407
  • [4] Supervised learning algorithm based on spike optimization mechanism for multilayer spiking neural networks
    Hu, Tiandou
    Lin, Xianghong
    Wang, Xiangwen
    Du, Pangao
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (07) : 1981 - 1995
  • [5] Temporal Coding in Spiking Neural Networks With Alpha Synaptic Function: Learning With Backpropagation
    Comsa, Iulia-Maria
    Potempa, Krzysztof
    Versari, Luca
    Fischbacher, Thomas
    Gesmundo, Andrea
    Alakuijala, Jyrki
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5939 - 5952
  • [6] Supervised Learning in Multilayer Spiking Neural Networks
    Sporea, Ioana
    Gruening, Andre
    NEURAL COMPUTATION, 2013, 25 (02) : 473 - 509
  • [7] Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networks
    Zhang, Wenrui
    Li, Peng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [8] Supervised Learning of Logical Operations in Layered Spiking Neural Networks with Spike Train Encoding
    Gruening, Andre
    Sporea, Ioana
    NEURAL PROCESSING LETTERS, 2012, 36 (02) : 117 - 134
  • [9] Supervised Learning Algorithm for Multilayer Spiking Neural Networks with Long-Term Memory Spike Response Model
    Lin, Xianghong
    Zhang, Mengwei
    Wang, Xiangwen
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021 (2021)
  • [10] Supervised Learning in Spiking Neural Networks with Synaptic Delay Plasticity: An Overview
    Lan, Yawen
    Li, Qiang
    CURRENT BIOINFORMATICS, 2020, 15 (08) : 854 - 865