Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation

被引:34
作者
Luo, Xiaoling [1 ]
Qu, Hong [1 ]
Wang, Yuchen [1 ]
Yi, Zhang [2 ]
Zhang, Jilun [1 ]
Zhang, Malu [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
基金
美国国家科学基金会;
关键词
Neurons; Delays; Nonhomogeneous media; Membrane potentials; Heuristic algorithms; Biological system modeling; Backpropagation; spike neural networks; spike neurons; supervised learning; synaptic delay plasticity; SYNAPTIC DELAY; ALGORITHM; CLASSIFICATION; NEURONS; RESUME;
D O I
10.1109/TNNLS.2022.3164930
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The brain-inspired spiking neural networks (SNNs) hold the advantages of lower power consumption and powerful computing capability. However, the lack of effective learning algorithms has obstructed the theoretical advance and applications of SNNs. The majority of the existing learning algorithms for SNNs are based on the synaptic weight adjustment. However, neuroscience findings confirm that synaptic delays can also be modulated to play an important role in the learning process. Here, we propose a gradient descent-based learning algorithm for synaptic delays to enhance the sequential learning performance of single spiking neuron. Moreover, we extend the proposed method to multilayer SNNs with spike temporal-based error backpropagation. In the proposed multilayer learning algorithm, information is encoded in the relative timing of individual neuronal spikes, and learning is performed based on the exact derivatives of the postsynaptic spike times with respect to presynaptic spike times. Experimental results on both synthetic and realistic datasets show significant improvements in learning efficiency and accuracy over the existing spike temporal-based learning algorithms. We also evaluate the proposed learning method in an SNN-based multimodal computational model for audiovisual pattern recognition, and it achieves better performance compared with its counterparts.
引用
收藏
页码:10141 / 10153
页数:13
相关论文
共 50 条
  • [21] Multilayer Photonic Spiking Neural Networks: Generalized Supervised Learning Algorithm and Network Optimization
    Fu, Chentao
    Xiang, Shuiying
    Han, Yanan
    Song, Ziwei
    Hao, Yue
    PHOTONICS, 2022, 9 (04)
  • [22] Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting
    Ponulak, Filip
    Kasinski, Andrzej
    NEURAL COMPUTATION, 2010, 22 (02) : 467 - 510
  • [23] Supervised learning in spiking neural networks with synaptic delay-weight plasticity
    Zhang, Malu
    Wu, Jibin
    Belatreche, Ammar
    Pan, Zihan
    Xie, Xiurui
    Chua, Yansong
    Li, Guoqi
    Qu, Hong
    Li, Haizhou
    NEUROCOMPUTING, 2020, 409 : 103 - 118
  • [24] A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks
    Miao, Yu
    Tang, Huajin
    Pan, Gang
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 420 - 426
  • [25] Spiking neural networks for handwritten digit recognition-Supervised learning and network optimization
    Kulkarni, Shruti R.
    Rajendran, Bipin
    NEURAL NETWORKS, 2018, 103 : 118 - 127
  • [26] Semi-Supervised Learning for Spiking Neural Networks Based on Spike-Timing-Dependent Plasticity
    Lee, Jongseok
    Sim, Donggyu
    IEEE ACCESS, 2023, 11 : 35140 - 35149
  • [27] AN ONLINE SUPERVISED LEARNING ALGORITHM BASED ON FEEDBACK ALIGNMENT FOR MULTILAYER SPIKING NEURAL NETWORKS
    Lin, Xianghong
    Hu, Jia
    Zheng, Donghao
    Hu, Tiandou
    Wang, Xiangwen
    PROCEEDINGS OF THE ROMANIAN ACADEMY SERIES A-MATHEMATICS PHYSICS TECHNICAL SCIENCES INFORMATION SCIENCE, 2022, 23 (02): : 187 - 196
  • [28] A Supervised Multi-spike Learning Algorithm for Recurrent Spiking Neural Networks
    Lin, Xianghong
    Shi, Guoyong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 : 222 - 234
  • [29] One-Pass Online Learning Based on Gradient Descent for Multilayer Spiking Neural Networks
    Lin, Xianghong
    Hu, Tiandou
    Wang, Xiangwen
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (01) : 16 - 31
  • [30] A Supervised Method for Learning Precise Timing of Multiple Spikes in Spiking Neural Networks
    Agebure, Moses Apambila
    Oyetunji, Elkanah Olaosebikan
    Baagyere, Edward Yellakuor
    2019 IEEE AFRICON, 2019,