TQ-TTFS: High-Accuracy and Energy-Efficient Spiking Neural Networks Using Temporal Quantization Time-to-First-Spike Neuron

被引:0
作者
Yang, Yuxuan [1 ]
Xuan, Zihao [1 ]
Kang, Yi [1 ]
机构
[1] Univ Sci & Technol China, Sch Microelect, Hefei, Anhui, Peoples R China
来源
29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024 | 2024年
关键词
D O I
10.1109/ASP-DAC58780.2024.10473964
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, spiking neural networks (SNNs) have gained attention for their biological realistic and event-driven characteristics, which align well with neuromorphic hardware. Time-to-First-Spike (TTFS) coding is an coding scheme for SNNs, where neurons are fired only once throughout the inference process, reducing the number of spikes and improving energy efficiency. However, the SNNs with TTFS coding face the issue of low classification accuracy. This paper introduces TQ-TTFS, a temporal quantization on TTFS neuron model to address this issue. In addition, the temporal quantization neurons can apply lower clock frequency without increasing inference latency, which can lead to higher energy efficiency. The experimental results show the effectiveness of the proposed temporal quantization neuron model in improving both classification accuracy and energy efficiency. In our simulations TQ-TTFS achieves classification accuracy of 98.6% on MNIST dataset and 90.2% on FashionMNIST dataset which are among SOTA of temporal coding SNNs. An analysis is also given to show that TQ-TTFS on an example SNN can have 2.94x energy efficiency improvement compared with tranditional TTFS coding.
引用
收藏
页码:836 / 841
页数:6
相关论文
共 21 条
[1]   Trainable quantization for Speedy Spiking Neural Networks [J].
Castagnetti, Andrea ;
Pegatoquet, Alain ;
Miramond, Benoit .
FRONTIERS IN NEUROSCIENCE, 2023, 17
[2]  
Comsa JM, 2020, INT CONF ACOUST SPEE, P8529, DOI [10.1109/ICASSP40776.2020.9053856, 10.1109/icassp40776.2020.9053856]
[3]   Neural Coding in Spiking Neural Networks: A Comparative Study for Robust Neuromorphic Systems [J].
Guo, Wenzhe ;
Fouda, Mohammed E. ;
Eltawil, Ahmed M. ;
Salama, Khaled Nabil .
FRONTIERS IN NEUROSCIENCE, 2021, 15
[4]   A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule [J].
Hao, Yunzhe ;
Huang, Xuhui ;
Dong, Meng ;
Xu, Bo .
NEURAL NETWORKS, 2020, 121 :387-395
[5]  
Horowitz M, 2014, ISSCC DIG TECH PAP I, V57, P10, DOI 10.1109/ISSCC.2014.6757323
[6]   BS4NN: Binarized Spiking Neural Networks with Temporal Coding and Learning [J].
Kheradpisheh, Saeed Reza ;
Mirsadeghi, Maryam ;
Masquelier, Timothee .
NEURAL PROCESSING LETTERS, 2022, 54 (02) :1255-1273
[7]   Temporal Backpropagation for Spiking Neural Networks with One Spike per Neuron [J].
Kheradpisheh, Saeed Reza ;
Masquelier, Timothee .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2020, 30 (06)
[8]   Deep neural networks with weighted spikes [J].
Kim, Jaehyun ;
Kim, Heesu ;
Huh, Subin ;
Lee, Jinho ;
Choi, Kiyoung .
NEUROCOMPUTING, 2018, 311 :373-386
[9]  
Kingma D.P., 2014, arXiv, DOI [DOI 10.48550/ARXIV.1412.6980, 10.48550/arXiv.1412.6980]
[10]   Quantization Framework for Fast Spiking Neural Networks [J].
Li, Chen ;
Ma, Lei ;
Furber, Steve .
FRONTIERS IN NEUROSCIENCE, 2022, 16