Toward Efficient Processing and Learning With Spikes: New Approaches for Multispike Learning

被引:11
作者
Yu, Qiang [1 ]
Li, Shenglan [1 ]
Tang, Huajin [2 ,3 ]
Wang, Longbiao [1 ]
Dang, Jianwu [1 ,4 ,5 ]
Tan, Kay Chen [6 ,7 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300072, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[3] Zhejiang Lab, Hangzhou 311122, Peoples R China
[4] Japan Adv Inst Sci & Technol, Lab Intelligent Informat Proc, Nomi 9231292, Japan
[5] Huiyan Technol Tianjin Co Ltd, Tianjin 300384, Peoples R China
[6] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[7] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Neurons; Task analysis; Computational modeling; Biological system modeling; Information processing; Neuromorphics; Feature extraction; multispike learning; neuromorphic computing; robust recognition; spiking neural networks (SNNs); spike-timing-dependent plasticity (STDP); NEURAL-NETWORK; MODEL; CLASSIFICATION; NOISE;
D O I
10.1109/TCYB.2020.2984888
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
[1]   Synaptic Learning With Augmented Spikes [J].
Yu, Qiang ;
Song, Shiming ;
Ma, Chenxiang ;
Pan, Linqiang ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (03) :1134-1146
[2]   Temporal Encoding and Multispike Learning Framework for Efficient Recognition of Visual Patterns [J].
Yu, Qiang ;
Song, Shiming ;
Ma, Chenxiang ;
Wei, Jianguo ;
Chen, Shengyong ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) :3387-3399
[3]   Improving Multispike Learning With Plastic Synaptic Delays [J].
Yu, Qiang ;
Gao, Jialu ;
Wei, Jianguo ;
Li, Jing ;
Tan, Kay Chen ;
Huang, Tiejun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) :10254-10265
[4]   Robust Environmental Sound Recognition With Sparse Key-Point Encoding and Efficient Multispike Learning [J].
Yu, Qiang ;
Yao, Yanli ;
Wang, Longbiao ;
Tang, Huajin ;
Dang, Jianwu ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) :625-638
[5]   Efficient Multispike Learning for Spiking Neural Networks Using Probability-Modulated Timing Method [J].
Hu, Ruihan ;
Chang, Sheng ;
Wang, Hao ;
He, Jin ;
Huang, Qijun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (07) :1984-1997
[6]   Efficient learning with augmented spikes: A case study with image classification [J].
Song, Shiming ;
Ma, Chenxiang ;
Sun, Wei ;
Xu, Junhai ;
Dang, Jianwu ;
Yu, Qiang .
NEURAL NETWORKS, 2021, 142 :205-212
[7]   New Efficient Multi-Spike Learning for Fast Processing and Robust Learning [J].
Li, Shenglan ;
Yu, Qiang .
THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 :4650-4657
[8]   An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning [J].
Xiao, Rong ;
Tang, Huajin ;
Ma, Yuhao ;
Yan, Rui ;
Orchard, Garrick .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) :3649-3657
[9]   Advancing Spiking Neural Networks Toward Deep Residual Learning [J].
Hu, Yifan ;
Deng, Lei ;
Wu, Yujie ;
Yao, Man ;
Li, Guoqi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (02) :2353-2367
[10]   A Supervised Learning Algorithm for Learning Precise Timing of Multiple Spikes in Multilayer Spiking Neural Networks [J].
Taherkhani, Aboozar ;
Belatreche, Ammar ;
Li, Yuhua ;
Maguire, Liam P. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) :5394-5407