<bold>HyperSpikeASIC</bold>: Accelerating Event-Based Workloads With HyperDimensional Computing and Spiking Neural Networks

被引:0
|
作者
Zhang, Tianqi [1 ]
Morris, Justing [2 ]
Stewart, Kenneth [3 ]
Lui, Hin Wai [3 ]
Khaleghi, Behnam [1 ]
Thomas, Anthony [1 ]
Goncalves-Marback, Thiago [1 ]
Aksanli, Baris [4 ]
Neftci, Emre O. [3 ]
Rosing, Tajana [1 ]
机构
[1] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
[2] Calif State Univ San Marcos, Dept Comp Sci & Informat Syst, San Marcos, CA 92096 USA
[3] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[4] San Diego State Univ, Dept Elect & Comp Engn, San Diego, CA 92182 USA
关键词
Neurons; Computational modeling; Encoding; Feature extraction; Training; Energy efficiency; Task analysis; Bio-inspired computing; hyperdimensional computing (HDC); neural network hardware (SNN); neuromorphic processor; spike neural network; LOIHI;
D O I
10.1109/TCAD.2023.3264167
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
machine learning (ML) systems, running workloads, such as deep neural networks, which require billions of parameters and many hours to train a model, consume a significant amount of energy. Due to the complexity of computation and topology, even the quantized models are hard to deploy on edge devices under energy constraints. To combat this, researchers have been focusing on new emerging neuromorphic computing models. Two of those models are hyperdimensional computing (HDC) and spiking neural networks (SNNs), both with their own benefits. HDC has various desirable properties that other ML algorithms lack, such as robustness to noise, simple operations, and high parallelism. SNNs are able to process event-based signal data in an efficient manner. This work develops HyperSpike, which utilizes a single, randomly initialized, and untrained SNN layer as a feature extractor connected to a trained HDC classifier. HDC is used to enable more efficient classification as well as provide robustness to errors. We experimentally show that HyperSpike is on average 31.5x more robust to errors than traditional SNNs. On Intel's Loihi (Davies et al., 2018), HyperSpike is 10x faster and 2.6x more energy efficient over traditional SNN networks. We further develop HyperSpikeASIC, a customized accelerator for HyperSpike. By decoupling the neuron and synapses, HyperSpikeASIC skips the inactive neurons and limits the neuron state updating to once per time step at most. HyperSpikeASIC is 601x faster and 3467x more energy efficient than HyperSpike running on Intel's Loihi for SNN acceleration, and 12.2x faster and 211x more energy efficient than the state-of-the-art SNN ASIC implementation (Wang et al., 2022).
引用
收藏
页码:3997 / 4010
页数:14
相关论文
共 50 条
  • [31] GaitSpike: Event-based Gait Recognition With Spiking Neural Network
    Tao, Ying
    Chang, Chip-Hong
    Saighi, Sylvain
    Gao, Shengyu
    2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024, 2024, : 357 - 361
  • [32] Event-Based Depth Prediction With Deep Spiking Neural Network
    Wu, Xiaoshan
    He, Weihua
    Yao, Man
    Zhang, Ziyang
    Wang, Yaoyuan
    Xu, Bo
    Li, Guoqi
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (06) : 2008 - 2018
  • [33] Toward Hardware Spiking Neural Networks with Mixed-Signal Event-Based Learning Rules
    Lewden, Pierre
    Vincent, Adrien F.
    Meyer, Charly
    Tomas, Jean
    Saighi, Sylvain
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [34] Event-based neural computing on an autonomous mobile platform
    Galluppi, Francesco
    Denk, Christian
    Meiner, Matthias C.
    Stewart, Terrence C.
    Plana, Luis A.
    Eliasmith, Chris
    Furber, Steve
    Conradt, Joerg
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 2862 - 2867
  • [35] Event-Based Circular Detection for AUV Docking Based on Spiking Neural Network
    Zhang, Feihu
    Zhong, Yaohui
    Chen, Liyuan
    Wang, Zhiliang
    FRONTIERS IN NEUROROBOTICS, 2022, 15
  • [36] SCTN: Event-based object tracking with energy-efficient deep convolutional spiking neural networks
    Ji, Mingcheng
    Wang, Ziling
    Yan, Rui
    Liu, Qingjie
    Xu, Shu
    Tang, Huajin
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [37] Event-Based Spiking Neural Networks for Object Detection: A Review of Datasets, Architectures, Learning Rules, and Implementation
    Iaboni, Craig
    Abichandani, Pramod
    IEEE ACCESS, 2024, 12 : 180532 - 180596
  • [38] Fusing Event-based Camera and Radar for SLAM Using Spiking Neural Networks with Continual STDP Learning
    Safa, Ali
    Verbelen, Tim
    Ocket, Ilja
    Bourdoux, Andre
    Sahli, Hichem
    Catthoor, Francky
    Gielen, Georges
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 2782 - 2788
  • [39] A Survey of Neuromorphic Computing Based on Spiking Neural Networks
    ZHANG Ming
    GU Zonghua
    PAN Gang
    ChineseJournalofElectronics, 2018, 27 (04) : 667 - 674
  • [40] A Survey of Neuromorphic Computing Based on Spiking Neural Networks
    Zhang Ming
    Gu Zonghua
    Pan Gang
    CHINESE JOURNAL OF ELECTRONICS, 2018, 27 (04) : 667 - 674