CRBA: A Competitive Rate-Based Algorithm Based on Competitive Spiking Neural Networks

被引:3
作者
Cachi, Paolo G. [1 ]
Ventura, Sebastian [2 ]
Cios, Krzysztof J. [1 ,3 ]
机构
[1] Virginia Commonwealth Univ, Dept Comp Sci, Richmond, VA 23284 USA
[2] Univ Cordoba, Dept Comp Sci, Cordoba, Spain
[3] Polish Acad Sci, Gliwice, Poland
关键词
rate-based algorithm; competitive spiking neural networks; competitive learning; unsupervised image classification; MNIST; PLASTICITY; RECOGNITION; MODEL;
D O I
10.3389/fncom.2021.627567
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
In this paper we present a Competitive Rate-Based Algorithm (CRBA) that approximates operation of a Competitive Spiking Neural Network (CSNN). CRBA is based on modeling of the competition between neurons during a sample presentation, which can be reduced to ranking of the neurons based on a dot product operation and the use of a discrete Expectation Maximization algorithm; the latter is equivalent to the spike time-dependent plasticity rule. CRBA's performance is compared with that of CSNN on the MNIST and Fashion-MNIST datasets. The results show that CRBA performs on par with CSNN, while using three orders of magnitude less computational time. Importantly, we show that the weights and firing thresholds learned by CRBA can be used to initialize CSNN's parameters that results in its much more efficient operation.
引用
收藏
页数:13
相关论文
共 37 条
[1]  
[Anonymous], 2018, 2018 INT JOINT C NEU, DOI [DOI 10.1109/IJCNN.2018.8489673, 10.1109/IJCNN.2018.8489673]
[2]  
[Anonymous], 2009, Advances in Neural Information Processing Systems
[3]  
[Anonymous], 2013, PMLR, DOI DOI 10.5555/3042817.3043055
[4]   Adaptive exponential integrate-and-fire model as an effective description of neuronal activity [J].
Brette, R ;
Gerstner, W .
JOURNAL OF NEUROPHYSIOLOGY, 2005, 94 (05) :3637-3642
[5]   Fast Convergence of Competitive Spiking Neural Networks with Sample-Based Weight Initialization [J].
Cachi, Paolo Gabriel ;
Ventura, Sebastian ;
Cios, Krzysztof Jozef .
INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS, IPMU 2020, PT III, 2020, 1239 :773-786
[6]  
Ciresan D, 2012, PROC CVPR IEEE, P3642, DOI 10.1109/CVPR.2012.6248110
[7]  
Comsa JM, 2020, INT CONF ACOUST SPEE, P8529, DOI [10.1109/icassp40776.2020.9053856, 10.1109/ICASSP40776.2020.9053856]
[8]   Recurrent Spiking Neural Network Learning Based on a Competitive Maximization of Neuronal Activity [J].
Demin, Vyacheslav ;
Nekhaev, Dmitry .
FRONTIERS IN NEUROINFORMATICS, 2018, 12
[9]  
Diehl PU, 2015, IEEE IJCNN
[10]   Unsupervised learning of digit recognition using spike-timing-dependent plasticity [J].
Diehl, Peter U. ;
Cook, Matthew .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2015, 9