<bold>HyperSpikeASIC</bold>: Accelerating Event-Based Workloads With HyperDimensional Computing and Spiking Neural Networks

被引:0
|
作者
Zhang, Tianqi [1 ]
Morris, Justing [2 ]
Stewart, Kenneth [3 ]
Lui, Hin Wai [3 ]
Khaleghi, Behnam [1 ]
Thomas, Anthony [1 ]
Goncalves-Marback, Thiago [1 ]
Aksanli, Baris [4 ]
Neftci, Emre O. [3 ]
Rosing, Tajana [1 ]
机构
[1] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
[2] Calif State Univ San Marcos, Dept Comp Sci & Informat Syst, San Marcos, CA 92096 USA
[3] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[4] San Diego State Univ, Dept Elect & Comp Engn, San Diego, CA 92182 USA
关键词
Neurons; Computational modeling; Encoding; Feature extraction; Training; Energy efficiency; Task analysis; Bio-inspired computing; hyperdimensional computing (HDC); neural network hardware (SNN); neuromorphic processor; spike neural network; LOIHI;
D O I
10.1109/TCAD.2023.3264167
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
machine learning (ML) systems, running workloads, such as deep neural networks, which require billions of parameters and many hours to train a model, consume a significant amount of energy. Due to the complexity of computation and topology, even the quantized models are hard to deploy on edge devices under energy constraints. To combat this, researchers have been focusing on new emerging neuromorphic computing models. Two of those models are hyperdimensional computing (HDC) and spiking neural networks (SNNs), both with their own benefits. HDC has various desirable properties that other ML algorithms lack, such as robustness to noise, simple operations, and high parallelism. SNNs are able to process event-based signal data in an efficient manner. This work develops HyperSpike, which utilizes a single, randomly initialized, and untrained SNN layer as a feature extractor connected to a trained HDC classifier. HDC is used to enable more efficient classification as well as provide robustness to errors. We experimentally show that HyperSpike is on average 31.5x more robust to errors than traditional SNNs. On Intel's Loihi (Davies et al., 2018), HyperSpike is 10x faster and 2.6x more energy efficient over traditional SNN networks. We further develop HyperSpikeASIC, a customized accelerator for HyperSpike. By decoupling the neuron and synapses, HyperSpikeASIC skips the inactive neurons and limits the neuron state updating to once per time step at most. HyperSpikeASIC is 601x faster and 3467x more energy efficient than HyperSpike running on Intel's Loihi for SNN acceleration, and 12.2x faster and 211x more energy efficient than the state-of-the-art SNN ASIC implementation (Wang et al., 2022).
引用
收藏
页码:3997 / 4010
页数:14
相关论文
共 50 条
  • [1] Event-Based Trajectory Prediction Using Spiking Neural Networks
    Debat, Guillaume
    Chauhan, Tushar
    Cottereau, Benoit R.
    Masquelier, Timothee
    Paindavoine, Michel
    Baures, Robin
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2021, 15
  • [2] A Markovian event-based framework for stochastic spiking neural networks
    Touboul, Jonathan D.
    Faugeras, Olivier D.
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2011, 31 (03) : 485 - 507
  • [3] A Markovian event-based framework for stochastic spiking neural networks
    Jonathan D. Touboul
    Olivier D. Faugeras
    Journal of Computational Neuroscience, 2011, 31 : 485 - 507
  • [4] Event-Based Regression with Spiking Networks
    Guerrero, Elisa
    Quintana, Fernando M.
    Guerrero-Lebrero, Maria P.
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2023, PT II, 2023, 14135 : 617 - 628
  • [5] HyperSpike: HyperDimensional Computing for More Efficient and Robust Spiking Neural Networks
    Morris, Justin
    Lui, Hin Wai
    Stewart, Kenneth
    Khaleghi, Behnam
    Thomas, Anthony
    Marback, Thiago
    Aksanli, Baris
    Neftci, Emre
    Rosing, Tajana
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 664 - 669
  • [6] eWB: Event-Based Weight Binarization Algorithm for Spiking Neural Networks
    Kim, Dohun
    Kim, Guhyun
    Hwang, Cheol Seong
    Jeong, Doo Seok
    IEEE ACCESS, 2021, 9 : 38097 - 38106
  • [7] Asynchronous Bioplausible Neuron for Spiking Neural Networks for Event-Based Vision
    Kachole, Sanket
    Sajwani, Hussain
    Naeini, Fariborz Baghaei
    Makris, Dimitrios
    Zweiri, Yahya
    COMPUTER VISION - ECCV 2024, PT LXIV, 2025, 15122 : 399 - 415
  • [8] Adversarial attacks on spiking convolutional neural networks for event-based vision
    Buechel, Julian
    Lenz, Gregor
    Hu, Yalun
    Sheik, Sadique
    Sorbaro, Martino
    FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [9] Efficient event-based robotic grasping perception using hyperdimensional computing
    Hassan, Eman
    Zou, Zhuowen
    Chen, Hanning
    Imani, Mohsen
    Zweiri, Yahya
    Saleh, Hani
    Mohammad, Baker
    INTERNET OF THINGS, 2024, 26
  • [10] Spiking Neural Networks With Adaptive Membrane Time Constant for Event-Based Tracking
    Zhang, Jiqing
    Zhang, Malu
    Wang, Yuanchen
    Liu, Qianhui
    Yin, Baocai
    Li, Haizhou
    Yang, Xin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 1009 - 1021