A Supervised Learning Algorithm for Recurrent Spiking Neural Networks Based on BP-STDP

被引:2
作者
Guo, Wenjun [1 ]
Lin, Xianghong [1 ]
Yang, Xiaofei [1 ]
机构
[1] Northwest Normal Univ, Coll Comp Sci & Engn, Lanzhou 730070, Peoples R China
来源
NEURAL INFORMATION PROCESSING, ICONIP 2021, PT V | 2021年 / 1516卷
基金
中国国家自然科学基金;
关键词
Recurrent spiking neural networks; Supervised learning algorithm; Spiking-timing dependent plasticity; Backpropagation; BACKPROPAGATION;
D O I
10.1007/978-3-030-92307-5_68
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural network model encodes information with precisely timed spike train, it is very suitable to process complex spatiotemporal patterns. Recurrent spiking neural network has more complex dynamics characteristics because of feedback connections, which makes it difficult to design efficient learning algorithms. This paper proposes a supervised learning algorithm to train recurrent spiking neural networks. By mapping the integrate-and-fire neuron model to the rectified linear unit activation function, the learning rule is induced using error backpropagation and spike-timing dependent plasticity mechanism. The results of spike train learning task and non-linear pattern classification show that the algorithm is effective to learn spatiotemporal patterns. In addition, the influences of different parameters on learning performance are analyzed.
引用
收藏
页码:583 / 590
页数:8
相关论文
共 11 条
[1]   Error-backpropagation in temporally encoded networks of spiking neurons [J].
Bohte, SM ;
Kok, JN ;
La Poutré, H .
NEUROCOMPUTING, 2002, 48 :17-37
[2]   Matching Recall and Storage in Sequence Learning with Spiking Neural Networks [J].
Brea, Johanni ;
Senn, Walter ;
Pfister, Jean-Pascal .
JOURNAL OF NEUROSCIENCE, 2013, 33 (23) :9565-9575
[3]   Real-time recurrent learning neural network for stream-flow forecasting [J].
Chang, FJ ;
Chang, LC ;
Huang, HL .
HYDROLOGICAL PROCESSES, 2002, 16 (13) :2577-2588
[4]  
Diehl P.U., Conversion of artificial recurrent neural net-works to spiking neural networks for low-power neuromorphic hardware
[5]   Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network [J].
Gilra, Aditya ;
Gerstner, Wulfram .
ELIFE, 2017, 6
[6]  
Kuroe Y, 2010, IEEE IJCNN
[7]  
Mountain DJ, 2016, 2016 IEEE INTERNATIONAL CONFERENCE ON REBOOTING COMPUTING (ICRC)
[8]   BP-STDP: Approximating backpropagation using spike timing dependent plasticity [J].
Tavanaei, Amirhossein ;
Maida, Anthony .
NEUROCOMPUTING, 2019, 330 :39-47
[9]  
Thiele J., 2017, A wake-sleep algorithm for recurrent, spiking neural networks
[10]   Supervised learning in spiking neural networks: A review of algorithms and evaluations [J].
Wang, Xiangwen ;
Lin, Xianghong ;
Dang, Xiaochao .
NEURAL NETWORKS, 2020, 125 :258-280