Bio-inspired Model Based on Global-Local Hybrid Learning in Spiking Neural Network

被引:3
作者
Wang, Yuchen [1 ]
Wang, Xiaobin [1 ]
Qu, Hong [1 ]
Zhang, Ya [1 ]
Chen, Yi [1 ]
Luo, Xiaoling [1 ]
机构
[1] Univ Elect Sci & Technol China, Comp Sci & Engn, Chengdu, Peoples R China
来源
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2021年
基金
美国国家科学基金会; 国家重点研发计划;
关键词
deep neural networks; spiking neural networks; hybrid learning; STDP;
D O I
10.1109/IJCNN52387.2021.9534061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Bringing machines up to human-level visual processing capabilities is an attractive research topic for decades. Deep neural networks (DNNs), inspired by the hierarchical structure of the human primary visual cortex at a macroscopic level, have achieved state-of-the-art performance in many applications. However, their practical applications remain limited due to the requisition of massive computing resources. Spiking neural networks (SNNs) simulate the spike-based information process of the biological neural system from the microscopic view and hold greater potential to ultra-low-power computations. In this paper, we imitate the human visual system from both the micro and macro scales and make the following contributions: (1) Inspired by the lateral effect between real neurons, we propose a GlobalLocal Hybrid Spike-Timing-Dependent Plasticity (GLHSTDP) algorithm that combines STDP with lateral synaptic learning mechanism, to train the spiking neural network. (2) We construct a deep spiking neural network (DSNN) to mimic the visual information processing mechanism in the human brain. Experimental results demonstrate that the proposed DSNN model equipped with the proposed learning algorithm works in a totally spikebased manner and achieve competitive accuracies on both the Caltech 101 and the MNIST datasets.
引用
收藏
页数:8
相关论文
共 29 条
[1]   An energy budget for signaling in the grey matter of the brain [J].
Attwell, D ;
Laughlin, SB .
JOURNAL OF CEREBRAL BLOOD FLOW AND METABOLISM, 2001, 21 (10) :1133-1145
[2]   Beyond the cortical column: abundance and physiology of horizontal connections imply a strong role for inputs from the surround [J].
Boucsein, Clemens ;
Nawrot, Martin P. ;
Schnepel, Philipp ;
Aertsen, Ad .
FRONTIERS IN NEUROSCIENCE, 2011, 5
[3]   Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition [J].
Cadieu, Charles F. ;
Hong, Ha ;
Yamins, Daniel L. K. ;
Pinto, Nicolas ;
Ardila, Diego ;
Solomon, Ethan A. ;
Majaj, Najib J. ;
DiCarlo, James J. .
PLOS COMPUTATIONAL BIOLOGY, 2014, 10 (12)
[4]   Spike timing-dependent plasticity: A Hebbian learning rule [J].
Caporale, Natalia ;
Dan, Yang .
ANNUAL REVIEW OF NEUROSCIENCE, 2008, 31 :25-46
[5]  
Conrad M, 2017, INT EL DEVICES MEET
[6]  
COOK ND, 2018, THE BRAIN CODE MECHA, V2
[7]   Lateral inhibition in the inner retina is important for spatial tuning of ganglion cells [J].
Cook, PB ;
McReynolds, JS .
NATURE NEUROSCIENCE, 1998, 1 (08) :714-719
[8]   How Does the Brain Solve Visual Object Recognition? [J].
DiCarlo, James J. ;
Zoccolan, Davide ;
Rust, Nicole C. .
NEURON, 2012, 73 (03) :415-434
[9]   Unsupervised learning of digit recognition using spike-timing-dependent plasticity [J].
Diehl, Peter U. ;
Cook, Matthew .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2015, 9
[10]  
Felleman Daniel J, 1991, Cerebral cortex