A novel spiking neural network of receptive field encoding with groups of neurons decision

被引:5
作者
Ma, Yong-qiang [1 ]
Wang, Zi-ru [1 ]
Yu, Si-yu [1 ]
Chen, Ba-dong [1 ]
Zheng, Nan-ning [1 ]
Ren, Peng-ju [1 ]
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Tempotron; Receptive field; Difference of Gaussian (DoG); Flip invariance; Rotation invariance; LEARNING ALGORITHM; MODEL; CLASSIFICATION;
D O I
10.1631/FITEE.1700714
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human information processing depends mainly on billions of neurons which constitute a complex neural network, and the information is transmitted in the form of neural spikes. In this paper, we propose a spiking neural network (SNN), named MD-SNN, with three key features: (1) using receptive field to encode spike trains from images; (2) randomly selecting partial spikes as inputs for each neuron to approach the absolute refractory period of the neuron; (3) using groups of neurons to make decisions. We test MD-SNN on the MNIST data set of handwritten digits, and results demonstrate that: (1) Different sizes of receptive fields influence classification results significantly. (2) Considering the neuronal refractory period in the SNN model, increasing the number of neurons in the learning layer could greatly reduce the training time, effectively reduce the probability of over-fitting, and improve the accuracy by 8.77%. (3) Compared with other SNN methods, MD-SNN achieves a better classification; compared with the convolution neural network, MD-SNN maintains flip and rotation invariance (the accuracy can remain at 90.44% on the test set), and it is more suitable for small sample learning (the accuracy can reach 80.15% for 1000 training samples, which is 7.8 times that of CNN).
引用
收藏
页码:139 / 150
页数:12
相关论文
共 45 条
[1]  
[Anonymous], 2010, International Journal on Computer Science and Engineering
[2]  
[Anonymous], 2011, INT C ART INT STAT
[3]  
[Anonymous], SUPERSPIKE SUPERVISE
[4]  
[Anonymous], 2002, SPIKING NEURON MODEL
[5]  
Berry MJ, 1998, ADV NEUR IN, V10, P110
[6]   Synaptic modification by correlated activity: Hebb's postulate revisited [J].
Bi, GQ ;
Poo, MM .
ANNUAL REVIEW OF NEUROSCIENCE, 2001, 24 :139-166
[7]   Adaptive exponential integrate-and-fire model as an effective description of neuronal activity [J].
Brette, R ;
Gerstner, W .
JOURNAL OF NEUROPHYSIOLOGY, 2005, 94 (05) :3637-3642
[8]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[10]   A neural algorithm for a fundamental computing problem [J].
Dasgupta, Sanjoy ;
Stevens, Charles F. ;
Navlakha, Saket .
SCIENCE, 2017, 358 (6364) :793-796