Toward Efficient Processing and Learning With Spikes: New Approaches for Multispike Learning

被引:11
|
作者
Yu, Qiang [1 ]
Li, Shenglan [1 ]
Tang, Huajin [2 ,3 ]
Wang, Longbiao [1 ]
Dang, Jianwu [1 ,4 ,5 ]
Tan, Kay Chen [6 ,7 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300072, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[3] Zhejiang Lab, Hangzhou 311122, Peoples R China
[4] Japan Adv Inst Sci & Technol, Lab Intelligent Informat Proc, Nomi 9231292, Japan
[5] Huiyan Technol Tianjin Co Ltd, Tianjin 300384, Peoples R China
[6] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[7] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Neurons; Task analysis; Computational modeling; Biological system modeling; Information processing; Neuromorphics; Feature extraction; multispike learning; neuromorphic computing; robust recognition; spiking neural networks (SNNs); spike-timing-dependent plasticity (STDP); NEURAL-NETWORK; MODEL; CLASSIFICATION; NOISE;
D O I
10.1109/TCYB.2020.2984888
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
  • [1] Synaptic Learning With Augmented Spikes
    Yu, Qiang
    Song, Shiming
    Ma, Chenxiang
    Pan, Linqiang
    Tan, Kay Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (03) : 1134 - 1146
  • [2] Temporal Encoding and Multispike Learning Framework for Efficient Recognition of Visual Patterns
    Yu, Qiang
    Song, Shiming
    Ma, Chenxiang
    Wei, Jianguo
    Chen, Shengyong
    Tan, Kay Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3387 - 3399
  • [3] Improving Multispike Learning With Plastic Synaptic Delays
    Yu, Qiang
    Gao, Jialu
    Wei, Jianguo
    Li, Jing
    Tan, Kay Chen
    Huang, Tiejun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 10254 - 10265
  • [4] Robust Environmental Sound Recognition With Sparse Key-Point Encoding and Efficient Multispike Learning
    Yu, Qiang
    Yao, Yanli
    Wang, Longbiao
    Tang, Huajin
    Dang, Jianwu
    Tan, Kay Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) : 625 - 638
  • [5] Efficient Multispike Learning for Spiking Neural Networks Using Probability-Modulated Timing Method
    Hu, Ruihan
    Chang, Sheng
    Wang, Hao
    He, Jin
    Huang, Qijun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (07) : 1984 - 1997
  • [6] Efficient learning with augmented spikes: A case study with image classification
    Song, Shiming
    Ma, Chenxiang
    Sun, Wei
    Xu, Junhai
    Dang, Jianwu
    Yu, Qiang
    NEURAL NETWORKS, 2021, 142 : 205 - 212
  • [7] New Efficient Multi-Spike Learning for Fast Processing and Robust Learning
    Li, Shenglan
    Yu, Qiang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 4650 - 4657
  • [8] An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning
    Xiao, Rong
    Tang, Huajin
    Ma, Yuhao
    Yan, Rui
    Orchard, Garrick
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) : 3649 - 3657
  • [9] Advancing Spiking Neural Networks Toward Deep Residual Learning
    Hu, Yifan
    Deng, Lei
    Wu, Yujie
    Yao, Man
    Li, Guoqi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (02) : 2353 - 2367
  • [10] A Supervised Learning Algorithm for Learning Precise Timing of Multiple Spikes in Multilayer Spiking Neural Networks
    Taherkhani, Aboozar
    Belatreche, Ammar
    Li, Yuhua
    Maguire, Liam P.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5394 - 5407