SpikeBASE: Spiking Neural Learning Algorithm With Backward Adaptation of Synaptic Efflux

被引:3
作者
Stauffer, Jake [1 ]
Zhang, Qingxue [1 ]
机构
[1] Purdue Univ, Sch Engn & Technol Indianapolis, Indianapolis, IN 46202 USA
关键词
Heuristic algorithms; Neurons; Deep learning; Backpropagation; Brain modeling; Spatiotemporal phenomena; Training; Neuromorphic computing; artificial intelligence; neural models; machine learning; INFORMATION; PLASTICITY; RULE;
D O I
10.1109/TC.2022.3197089
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-inspired Spiking Neural Network (SNN) is opening new possibilities towards human-level intelligence, by leveraging its nature of spatiotemporal information encoding and processing that bring both learning effectiveness and energy efficiency. Although substantial advances in SNN studies have been made, highly effective SNN learning algorithms are still urged, driven by the challenges of coordinating spiking spatiotemporal dynamics. We therefore propose a novel algorithm, SpikeBASE, denoting Spiking learning with Backward Adaption of Synaptic Efflux, to globally, supervisedly, and comprehensively coordinate the synaptic dynamics including both synaptic strength and responses. SpikeBASE can learn synaptic strength by backpropagating the error through the predefined synaptic responses. More importantly, SpikeBASE enables synaptic response adaptation through backpropagation, to mimic the complex dynamics of neural transmissions. Further, SpikeBASE enables multi-scale temporal memory formation by supporting multi-synaptic response adaptation. We have evaluated the algorithm on a challenging scarce data learning task and shown highly promising performance. The proposed SpikeBASE algorithm, through comprehensively coordinating the learning of synaptic strength, synaptic responses, and multi-scale temporal memory formation, has demonstrated its effectiveness on end-to-end SNN training. This study is expected to greatly advance the learning effectiveness of SNN and thus broadly benefit smart and efficient big data applications.
引用
收藏
页码:2707 / 2716
页数:10
相关论文
共 43 条
[1]  
[Anonymous], 2001, HDB BIOL PHYS, DOI 10.1016/S1383-8121(01)80015-4
[2]  
Ballester P, 2016, AAAI CONF ARTIF INTE, P1124
[3]  
Shrestha SB, 2018, Arxiv, DOI arXiv:1810.08646
[4]  
Canziani A., 2016, arXiv
[5]  
Diehl PU, 2015, IEEE IJCNN
[6]  
Ding JH, 2021, Arxiv, DOI arXiv:2105.11654
[7]   Electrooculography-based continuous eye-writing recognition system for efficient assistive communication systems [J].
Fang, Fuming ;
Shinozaki, Takahiro .
PLOS ONE, 2018, 13 (02)
[8]  
Fang HW, 2020, Arxiv, DOI arXiv:2003.02944
[9]   Regulation of synaptic responses to high-frequency stimulation and LTP by neurotrophins in the hippocampus [J].
Figurov, A ;
PozzoMiller, LD ;
Olafsson, P ;
Wang, T ;
Lu, B .
NATURE, 1996, 381 (6584) :706-709
[10]  
Gavrilov AV, 2016, INT CONF ACT PROB EL, P455, DOI 10.1109/APEIE.2016.7806372