Toward Efficient Processing and Learning With Spikes: New Approaches for Multispike Learning

被引:11
作者
Yu, Qiang [1 ]
Li, Shenglan [1 ]
Tang, Huajin [2 ,3 ]
Wang, Longbiao [1 ]
Dang, Jianwu [1 ,4 ,5 ]
Tan, Kay Chen [6 ,7 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300072, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[3] Zhejiang Lab, Hangzhou 311122, Peoples R China
[4] Japan Adv Inst Sci & Technol, Lab Intelligent Informat Proc, Nomi 9231292, Japan
[5] Huiyan Technol Tianjin Co Ltd, Tianjin 300384, Peoples R China
[6] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[7] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Neurons; Task analysis; Computational modeling; Biological system modeling; Information processing; Neuromorphics; Feature extraction; multispike learning; neuromorphic computing; robust recognition; spiking neural networks (SNNs); spike-timing-dependent plasticity (STDP); NEURAL-NETWORK; MODEL; CLASSIFICATION; NOISE;
D O I
10.1109/TCYB.2020.2984888
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
  • [21] In the fast lane toward structure in implicit learning: Nonanalytic processing and fluency in artificial grammar learning
    Johansson, Tobias
    EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2009, 21 (01): : 129 - 160
  • [22] Robust Neural Networks Learning: New Approaches
    Shibzukhov, Z. M.
    ADVANCES IN NEURAL NETWORKS - ISNN 2018, 2018, 10878 : 247 - 255
  • [23] A Comparative Study of Deep Learning Approaches for Arabic Language Processing
    Mohamed, Mahmoud
    Alosman, Khaled
    JORDAN JOURNAL OF ELECTRICAL ENGINEERING, 2025, 11 (01): : 18 - 34
  • [24] Deep Learning Approaches to Image Texture Analysis in Material Processing
    Liu, Xiu
    Aldrich, Chris
    METALS, 2022, 12 (02)
  • [25] Expanding NEON biodiversity surveys with new instrumentation and machine learning approaches
    Kitzes, Justin
    Blake, Rachael
    Bombaci, Sara
    Chapman, Melissa
    Duran, Sandra M.
    Huang, Tao
    Joseph, Maxwell B.
    Lapp, Samuel
    Marconi, Sergio
    Oestreich, William K.
    Rhinehart, Tessa A.
    Schweiger, Anna K.
    Song, Yiluan
    Surasinghe, Thilina
    Yang, Di
    Yule, Kelsey
    ECOSPHERE, 2021, 12 (11):
  • [26] Toward Causal Representation Learning
    Schoelkopf, Bernhard
    Locatello, Francesco
    Bauer, Stefan
    Ke, Nan Rosemary
    Kalchbrenner, Nal
    Goyal, Anirudh
    Bengio, Yoshua
    PROCEEDINGS OF THE IEEE, 2021, 109 (05) : 612 - 634
  • [27] Machine Learning Approaches in Polymer Science: Progress and Fundamental for a New Paradigm
    Xie, Chunhui
    Qiu, Haoke
    Liu, Lu
    You, Yang
    Li, Hongfei
    Li, Yunqi
    Sun, Zhaoyan
    Lin, Jiaping
    An, Lijia
    SMARTMAT, 2025, 6 (01):
  • [28] Stroke Prediction Using Deep Learning and Transfer Learning Approaches
    Shih, Dong-Her
    Wu, Yi-Huei
    Wu, Ting-Wei
    Chu, Huei-Ying
    Shih, Ming-Hung
    IEEE ACCESS, 2024, 12 : 130091 - 130104
  • [29] An Efficient Iterative Approach to Explainable Feature Learning
    Vlahek, Dino
    Mongus, Domen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (05) : 2606 - 2618
  • [30] Toward Point-of-Interest Recommendation Systems: A Critical Review on Deep-Learning Approaches
    Safavi, Sadaf
    Jalali, Mehrdad
    Houshmand, Mahboobeh
    ELECTRONICS, 2022, 11 (13)