Exploring Spike-Based Learning for Neuromorphic Computing: Prospects and Perspectives

被引:9
作者
Rathi, Nitin [1 ]
Agrawal, Amogh [1 ]
Lee, Chankyu [1 ]
Kosta, Adarsh Kumar [1 ]
Roy, Kaushik [1 ]
机构
[1] Purdue Univ, Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
来源
PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021) | 2021年
基金
美国国家科学基金会;
关键词
Spiking neural networks; event cameras; spiking backpropagation; liquid state machine; in-memory computing; NETWORKS;
D O I
10.23919/DATE51398.2021.9473964
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking neural networks (SNNs) operating with sparse binary signals (spikes) implemented on event-driven hardware can potentially be more energy-efficient than traditional artificial neural networks (ANNs). However, SNNs perform computations over time, and the neuron activation function does not have a well-defined derivative leading to unique training challenges. In this paper, we discuss the various spike representations and training mechanisms for deep SNNs. Additionally, we review applications that go beyond classification, like gesture recognition, motion estimation, and sequential learning. The unique features of SNNs, such as high activation sparsity and spike-based computations, can be leveraged in hardware implementations for energy-efficient processing. To that effect, we discuss various SNN implementations, both using digital ASICs as well as analog in-memory computing primitives. Finally, we present an outlook on future applications and open research areas for both SNN algorithms and hardware implementations.
引用
收藏
页码:902 / 907
页数:6
相关论文
共 50 条
  • [31] Synthesizing Images From Spatio-Temporal Representations Using Spike-Based Backpropagation
    Roy, Deboleena
    Panda, Priyadarshini
    Roy, Kaushik
    FRONTIERS IN NEUROSCIENCE, 2019, 13
  • [32] Online spike-based recognition of digits with ultrafast microlaser neurons
    Masominia, Amir
    Calvet, Laurie E.
    Thorpe, Simon
    Barbay, Sylvain
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2023, 17
  • [33] Spike-based computation using classical recurrent neural networks
    De Geeter, Florent
    Ernst, Damien
    Drion, Guillaume
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2024, 4 (02):
  • [34] Progress on neuromorphic computing based on biomolecules
    Teng, Yue
    Yang, Shan
    Liu, Ruicun
    CHINESE SCIENCE BULLETIN-CHINESE, 2021, 66 (31): : 3944 - 3951
  • [35] A Spike-Based Long Short-Term Memory on a Neurosynaptic Processor
    Shrestha, Amar
    Ahmed, Khadeer
    Wang, Yanzhi
    Widemann, David P.
    Moody, Adam T.
    Van Essen, Brian C.
    Qiu, Qinru
    2017 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2017, : 631 - 637
  • [36] Spike-Based Synaptic Plasticity in Silicon: Design, Implementation, Application, and Challenges
    Azghadi, Mostafa Rahimi
    Iannella, Nicolangelo
    Al-Sarawi, Said F.
    Indiveri, Giacomo
    Abbott, Derek
    PROCEEDINGS OF THE IEEE, 2014, 102 (05) : 717 - 737
  • [37] Adaptive Input-to-Neuron Interlink Development in Training of Spike-Based Liquid State Machines
    Hwang, Sangwoo
    Lee, Junghyup
    Kung, Jaeha
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [38] Brain-inspired nanophotonic spike computing: challenges and prospects
    Romeira, Bruno
    Adao, Ricardo
    Nieder, Jana B.
    Al-Taai, Qusay
    Zhang, Weikang
    Hadfield, Robert H.
    Wasige, Edward
    Hejda, Matej
    Hurtado, Antonio
    Malysheva, Ekaterina
    Calzadilla, Victor Dolores
    Lourenco, Joao
    Alves, D. Castro
    Figueiredo, Jose M. L.
    Ortega-Piwonka, Ignacio
    Javaloyes, Julien
    Edwards, Stuart
    Davies, J. Iwan
    Horst, Folkert
    Offrein, Bert J.
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2023, 3 (03):
  • [39] Neuromorphic Analog Implementation of Reservoir Computing for Machine Learning
    Hazan, Avi
    Tsur, Elishai Ezra
    2022 29TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (IEEE ICECS 2022), 2022,
  • [40] SPIDE: A purely spike-based method for training feedback spiking neural networks
    Xiao, Mingqing
    Meng, Qingyan
    Zhang, Zongpeng
    Wang, Yisen
    Lin, Zhouchen
    NEURAL NETWORKS, 2023, 161 : 9 - 24