Quantization-Aware Training of Spiking Neural Networks for Energy-Efficient Spectrum Sensing on Loihi Chip

被引:1
作者
Liu, Shiya [1 ]
Mohammadi, Nima [1 ]
Yi, Yang [1 ]
机构
[1] Virginia Tech, Bradley Dept Elect & Comp Engn, Blacksburg, VA 24061 USA
来源
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING | 2024年 / 8卷 / 02期
基金
美国国家科学基金会;
关键词
Spectrum sensing; spiking neural networks; quantization; quantization-aware training; OPTIMIZATION;
D O I
10.1109/TGCN.2023.3337748
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Spectrum sensing is a technique used to identify idle/busy bandwidths in cognitive radio. Energy-efficient spectrum sensing is critical for multiple-input-multiple-output (MIMO) orthogonal-frequency-division multiplexing (OFDM) systems. In this paper, we propose the use of spiking neural networks (SNNs), which are more biologically plausible and energy-efficient than deep neural networks (DNNs), for spectrum sensing. The SNN models are implemented on the Loihi chip, which is better suited for SNNs than GPUs. Quantization is an effective technique to reduce the memory and energy consumption of SNNs. However, previous quantization methods for SNNs have suffered from accuracy degradation when compared to full-precision models. This degradation can be attributed to errors introduced by the coarse estimation of gradients in non-differentiable quantization layers. To address this issue, we introduce a quantization-aware training algorithm for SNNs running on Loihi. To mitigate errors caused by the poor estimation of gradients, we do not use a fixed configuration for the quantizer, as is common in existing SNN quantization methods. Instead, we make the scale parameters of the quantizer trainable. Furthermore, our proposed method adopts a probability-based scheme to selectively quantize individual layers within the network, rather than quantizing all layers simultaneously. Our experimental results demonstrate that high-performance and energy-efficient spectrum sensing can be achieved using Loihi.
引用
收藏
页码:827 / 838
页数:12
相关论文
共 49 条
  • [1] Enabling cyber-physical communication in 5G cellular networks: Challenges, spatial spectrum sensing, and cyber-security
    [J]. Liu, Lingjia (lingjialiu@gmail.com), 1600, Institution of Engineering and Technology, United States (02):
  • [2] Bengio Y, 2013, Arxiv, DOI arXiv:1308.3432
  • [3] Benchmarking Keyword Spotting Efficiency on Neuromorphic Hardware
    Blouw, Peter
    Choo, Xuan
    Hunsberger, Eric
    Eliasmith, Chris
    [J]. PROCEEDINGS OF THE 2019 7TH ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS WORKSHOP (NICE 2019), 2020,
  • [4] C. V. N. Index, 2019, White Paper
  • [5] Spike timing-dependent plasticity: A Hebbian learning rule
    Caporale, Natalia
    Dan, Yang
    [J]. ANNUAL REVIEW OF NEUROSCIENCE, 2008, 31 : 25 - 46
  • [6] Comsa JM, 2020, INT CONF ACOUST SPEE, P8529, DOI [10.1109/icassp40776.2020.9053856, 10.1109/ICASSP40776.2020.9053856]
  • [7] ACE-SNN: Algorithm-Hardware Co-design of Energy-Efficient & Low-Latency Deep Spiking Neural Networks for 3D Image Recognition
    Datta, Gourav
    Kundu, Souvik
    Jaiswal, Akhilesh R.
    Beerel, Peter A.
    [J]. FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [8] Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
    Davies, Mike
    Srinivasa, Narayan
    Lin, Tsung-Han
    Chinya, Gautham
    Cao, Yongqiang
    Choday, Sri Harsha
    Dimou, Georgios
    Joshi, Prasad
    Imam, Nabil
    Jain, Shweta
    Liao, Yuyun
    Lin, Chit-Kwan
    Lines, Andrew
    Liu, Ruokun
    Mathaikutty, Deepak
    Mccoy, Steve
    Paul, Arnab
    Tse, Jonathan
    Venkataramanan, Guruguhanathan
    Weng, Yi-Hsin
    Wild, Andreas
    Yang, Yoonseok
    Wang, Hong
    [J]. IEEE MICRO, 2018, 38 (01) : 82 - 99
  • [9] Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task
    Forno, Evelina
    Fra, Vittorio
    Pignari, Riccardo
    Macii, Enrico
    Urgese, Gianvito
    [J]. FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [10] SPIKING NEURAL NETWORKS
    Ghosh-Dastidar, Samanwoy
    Adeli, Hojjat
    [J]. INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2009, 19 (04) : 295 - 308