A Resource-Efficient Scalable Spiking Neural Network Hardware Architecture With Reusable Modules and Memory Reutilization

被引:2
作者
Wang, Ran [1 ,2 ]
Zhang, Jian [3 ,4 ]
Wang, Tengbo [5 ]
Liu, Jia [6 ]
Zhang, Guohe [1 ,2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Microelect, Xian 710049, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Key Lab Micronano Elect & Syst Integrat Xian City, Xian 710049, Shaanxi, Peoples R China
[3] Peking Univ, Sch Integrated Circuits, Beijing 100871, Peoples R China
[4] Beijing Microelect Technol Inst, Beijing 100076, Peoples R China
[5] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
[6] China Elect Technol Grp Corp, Inst 24, Chongqing 400060, Peoples R China
关键词
Convolution; Neurons; Computer architecture; Biological neural networks; Membrane potentials; Kernel; Hardware; Neuromorphic computing; spiking convolutional neural networks (SCNNs); image classification; energy efficiency; field programmable gate array (FPGA); PROCESSOR;
D O I
10.1109/TCSII.2023.3301180
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this brief, a cost-efficient and scalable spiking convolution neural network architecture is proposed. Reusable modules are designed to reduce hardware resource consumption by leveraging the structural similarity of each convolutional layer and pooling layer in spiking convolutional neural network (SCNN). Taking advantage of time-driven neural processing, memory reutilization is applied to reduce the memory for storing neural states. Benefit from these reusable modules, the proposed architecture demonstrates outstanding scalability. Two SCNN structures (named SCNN I and SCNN II) with different complexities and scales are designed to handle different classification tasks. The experiments are conducted using Xilinx Kintex-7 FPGA, operating at a clock frequency of 100 MHz. SCNN I and SCNN II achieve accuracy results of 98.15% and 85.71% respectively on the MNIST and CIFAR-10 datasets. Additionally, the energy consumption for each classification task is recorded as 0.015mJ and 0.724mJ. These results highlight the suitability of the proposed architecture for deployment in resource-constrained real-time edge processing scenarios.
引用
收藏
页码:430 / 434
页数:5
相关论文
共 21 条
[1]   DeepFire: Acceleration of Convolutional Spiking Neural Network on Modern Field Programmable Gate Arrays [J].
Aung, Myat Thu Linn ;
Qu, Chuping ;
Yang, Liwei ;
Luo, Tao ;
Goh, Rick Siow Mong ;
Wong, Weng-Fai .
2021 31ST INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE LOGIC AND APPLICATIONS (FPL 2021), 2021, :28-32
[2]   Simulating spiking neural networks on GPU [J].
Brette, Romain ;
Goodman, Dan F. M. .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2012, 23 (04) :167-182
[3]   A review of the integrate-and-fire neuron model: I. Homogeneous synaptic input [J].
Burkitt, A. N. .
BIOLOGICAL CYBERNETICS, 2006, 95 (01) :1-19
[4]   Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition [J].
Cao, Yongqiang ;
Chen, Yang ;
Khosla, Deepak .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) :54-66
[5]   Loihi: A Neuromorphic Manycore Processor with On-Chip Learning [J].
Davies, Mike ;
Srinivasa, Narayan ;
Lin, Tsung-Han ;
Chinya, Gautham ;
Cao, Yongqiang ;
Choday, Sri Harsha ;
Dimou, Georgios ;
Joshi, Prasad ;
Imam, Nabil ;
Jain, Shweta ;
Liao, Yuyun ;
Lin, Chit-Kwan ;
Lines, Andrew ;
Liu, Ruokun ;
Mathaikutty, Deepak ;
Mccoy, Steve ;
Paul, Arnab ;
Tse, Jonathan ;
Venkataramanan, Guruguhanathan ;
Weng, Yi-Hsin ;
Wild, Andreas ;
Yang, Yoonseok ;
Wang, Hong .
IEEE MICRO, 2018, 38 (01) :82-99
[6]   SpikeNET: A simulator for modeling large networks of integrate and fire neurons [J].
Delorme, A ;
Gautrais, J ;
van Rullen, R ;
Thorpe, S .
NEUROCOMPUTING, 1999, 26-7 :989-996
[7]  
Feng G, 2016, 2016 13TH IEEE INTERNATIONAL CONFERENCE ON SOLID-STATE AND INTEGRATED CIRCUIT TECHNOLOGY (ICSICT), P624, DOI 10.1109/ICSICT.2016.7998996
[8]   E3NE: An End-to-End Framework for Accelerating Spiking Neural Networks With Emerging Neural Encoding on FPGAs [J].
Gerlinghoff, Daniel ;
Wang, Zhehui ;
Gu, Xiaozhe ;
Goh, Rick Siow Mong ;
Luo, Tao .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (11) :3207-3219
[9]   Hardware Implementation of Spiking Neural Networks on FPGA [J].
Han, Jianhui ;
Li, Zhaolin ;
Zheng, Weimin ;
Zhang, Youhui .
TSINGHUA SCIENCE AND TECHNOLOGY, 2020, 25 (04) :479-486
[10]   An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification [J].
Ju, Xiping ;
Fang, Biao ;
Yan, Rui ;
Xu, Xiaoliang ;
Tang, Huajin .
NEURAL COMPUTATION, 2020, 32 (01) :182-204