Improving multi-layer spiking neural networks by incorporating brain-inspired rules受脑启发的学习规则对深层脉冲神经网络性能的提升

被引:0
作者
Yi Zeng
Tielin Zhang
Bo Xu
机构
[1] Chinese Academy of Sciences,Institute of Automation
[2] Chinese Academy of Sciences,Center for Excellence in Brain Science and Intelligence Technology
来源
Science China Information Sciences | 2017年 / 60卷
关键词
brain-inspired rules; spiking neural network; plasticity; classification task; 052201; 受脑启发的学习规则; 脉冲神经网络; 可塑性; 分类;
D O I
暂无
中图分类号
学科分类号
摘要
This paper introduces seven brain-inspired rules that are deeply rooted in the understanding of the brain to improve multi-layer spiking neural networks (SNNs). The dynamics of neurons, synapses, and plasticity models are considered to be major characteristics of information processing in brain neural networks. Hence, incorporating these models and rules to traditional SNNs is expected to improve their efficiency. The proposed SNN model can mainly be divided into three parts: the spike generation layer, the hidden layers, and the output layer. In the spike generation layer, non-temporary signals such as static images are converted into spikes by both local and global feature-converting methods. In the hidden layers, the rules of dynamic neurons, synapses, the proportion of different kinds of neurons, and various spike timing dependent plasticity (STDP) models are incorporated. In the output layer, the function of classification for excitatory neurons and winner take all (WTA) for inhibitory neurons are realized. MNIST dataset is used to validate the classification accuracy of the proposed neural network model. Experimental results show that higher accuracy will be achieved when more brain-inspired rules (with careful selection) are integrated into the learning procedure.
引用
收藏
相关论文
共 64 条
  • [1] Hinton G(2006)A fast learning algorithm for deep belief nets Neural Comput 18 1527-1554
  • [2] Osindero S(1997)Networks of spiking neurons: the third generation of neural network models Neural Networks 10 1659-1671
  • [3] Teh Y W(2012)A large-scale model of the functioning brain Science 338 1202-1205
  • [4] Maass W(2015)Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks Nat Commun 6 6922-87
  • [5] Eliasmith C(2016)Training excitatory-inhibitory recurrent neural networks for cognitive tasks: a simple and flexible framework PLoS Comput Biol 12 e1004792-108
  • [6] Stewart T(2015)A GPU-accelerated cortical neural network model for visually guided robot navigation Neural Networks 72 75-1830
  • [7] Choo X(2015)An embodied biologically constrained model of foraging: from classical and operant conditioning to adaptive real-world behavior in DAC-X Neural Networks 72 88-124
  • [8] Zenke F(2010)Swat: a spiking neural network training algorithm for classification problems IEEE Trans Neur Net 21 1817-1572
  • [9] Agnes E(2013)Categorization and decision-making in a neurobiologically plausible spiking network using a STDP-like learning rule Neural Networks 48 109-11
  • [10] Gerstner W(2003)Simple model of spiking neurons IEEE Trans Neur Net 14 1569-308