Quantisation and pooling method for low-inference-latency spiking neural networks

被引:10
作者
Lin, Zhitao [1 ]
Shen, Juncheng [1 ]
Ma, De [2 ]
Meng, Jianyi [3 ]
机构
[1] Zhejiang Univ, Inst VLSI Design, Hangzhou, Zhejiang, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci, Hangzhou, Zhejiang, Peoples R China
[3] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
关键词
neural nets; object recognition; real-time recognition tasks; CIFAR10; MNIST; spiking neurons; convolutional layers; pooling function; retraining; layer-wise quantisation method; DNN; deep neural network; SNN; low-inference-latency spiking neural networks; pooling method;
D O I
10.1049/el.2017.2219
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Spiking neural network (SNN) that converted from conventional deep neural network (DNN) has shown great potential as a solution for fast and efficient recognition. A layer-wise quantisation method based on retraining is proposed to quantise the activation of DNN, which reduces the number of time steps required by converted SNN to achieve minimal accuracy loss. Pooling function is incorporated into convolutional layers to reduce at most 20% of spiking neurons. The converted SNNs achieved 99.15% accuracy on MNIST and 82.9% on CIFAR10 by only seven time steps, and only 10-40% of spikes need to be processed compared with networks using traditional algorithms. The experimental results show that the proposed methods are able to build hardware-friendly SNNs with ultra-low-inference latency.
引用
收藏
页码:1347 / 1348
页数:2
相关论文
共 6 条
[1]   Neuromorphic VLSI Bayesian integration synapse [J].
Aggarwal, A. .
ELECTRONICS LETTERS, 2015, 51 (03) :207-209
[2]  
[Anonymous], ARXIV161204052
[3]   Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition [J].
Cao, Yongqiang ;
Chen, Yang ;
Khosla, Deepak .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) :54-66
[4]  
Diehl P. U., 2015, IJCNN, P2933, DOI 10.1109/IJCNN.2015.7280696
[5]  
Neil Daniel, 2016, P 31 ANN ACM S APPL, P293, DOI 10.1145/2851613.2851724
[6]   Reconfigurable neuromorphic crossbars based on titanium oxide memristors [J].
Wang, S. ;
Wang, W. ;
Yakopcic, C. ;
Shin, E. ;
Subramanyam, G. ;
Taha, T. M. .
ELECTRONICS LETTERS, 2016, 52 (20) :1673-U27