Enabling Resource-Aware Mapping of Spiking Neural Networks via Spatial Decomposition

被引:11
作者
Balaji, Adarsha [1 ]
Song, Shihao [1 ]
Das, Anup [1 ]
Krichmar, Jeffrey [2 ]
Dutt, Nikil [2 ]
Shackleford, James [1 ]
Kandasamy, Nagarajan [1 ]
Catthoor, Francky [3 ,4 ]
机构
[1] Drexel Univ, Dept Elect & Comp Engn, Philadelphia, PA 19104 USA
[2] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[3] IMEC, B-3001 Leuven, Belgium
[4] Katholieke Univ Leuven, ESAT, B-3000 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Computation graph; machine learning; neuromorphic computing; spiking neural networks (SNNs); TRADE-OFFS;
D O I
10.1109/LES.2020.3025873
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With growing model complexity, mapping spiking neural network (SNN)-based applications to tile-based neuromorphic hardware is becoming increasingly challenging. This is because the synaptic storage resources on a tile, viz., a crossbar, can accommodate only a fixed number of presynaptic connections per postsynaptic neuron. For complex SNN models that have many presynaptic connections per neuron, some connections may need to be pruned after training to fit onto the tile resources, leading to a loss in the model quality, e.g., accuracy. In this letter, we propose a novel unrolling technique that decomposes a neuron function with many presynaptic connections into a sequence of homogeneous neural units, where each neural unit is a function computation node, with two presynaptic connections. This spatial decomposition technique significantly improves crossbar utilization and retains all presynaptic connections, resulting in no loss of the model quality derived from connection pruning. We integrate the proposed technique within an existing SNN mapping framework and evaluate it using machine learning applications on the DYNAP-SE state-of-the-art neuromorphic hardware. Our results demonstrate an average 60% lower crossbar requirement, $9\times $ higher synapse utilization, 62% lower wasted energy on the hardware, and between 0.8% and 4.6% increase in the model quality.
引用
收藏
页码:142 / 145
页数:4
相关论文
共 22 条
[1]   A Framework for the Analysis of Throughput-Constraints of SNNs on Neuromorphic Hardware. [J].
Balaji, Adarsha ;
Das, Anup .
2019 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2019), 2019, :194-197
[2]   Mapping Spiking Neural Networks to Neuromorphic Hardware [J].
Balaji, Adarsha ;
Das, Anup ;
Wu, Yuefeng ;
Huynh, Khanh ;
Dell'Anna, Francesco G. ;
Indiveri, Giacomo ;
Krichmar, Jeffrey L. ;
Dutt, Nikil D. ;
Schaafsma, Siebren ;
Catthoor, Francky .
IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2020, 28 (01) :76-86
[3]   Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware [J].
Balaji, Adarsha ;
Marty, Thibaut ;
Das, Anup ;
Catthoor, Francky .
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2020, 92 (11) :1293-1302
[4]   A Framework to Explore Workload-Specific Performance and Lifetime Trade-offs in Neuromorphic Computing [J].
Balaji, Adarsha ;
Song, Shihao ;
Das, Anup ;
Dutt, Nikil ;
Krichmar, Jeff ;
Kandasamy, Nagarajan ;
Catthoor, Francky .
IEEE COMPUTER ARCHITECTURE LETTERS, 2019, 18 (02) :149-152
[5]   Power-Accuracy Trade-Offs for Heartbeat Classification on Neural Networks Hardware [J].
Balaji, Adarsha ;
Corradi, Federico ;
Das, Anup ;
Pande, Sandeep ;
Schaafsma, Siebren ;
Catthoor, Francky .
JOURNAL OF LOW POWER ELECTRONICS, 2018, 14 (04) :508-519
[6]  
BALAKRISHNAN A, 2020, P IEEE GLOBECOM, P1, DOI DOI 10.1109/IJCNN48605.2020.9207142
[7]   Dataflow-Based Mapping of Spiking Neural Networks on Neuromorphic Hardware [J].
Das, Anup ;
Kumar, Akash .
PROCEEDINGS OF THE 2018 GREAT LAKES SYMPOSIUM ON VLSI (GLSVLSI'18), 2018, :419-422
[8]   Heartbeat Classification in Wearables Using Multi-layer Perceptron and Time-Frequency Joint Distribution of ECG [J].
Das, Anup ;
Catthoor, Francky ;
Schaafsma, Siebren .
2018 IEEE/ACM INTERNATIONAL CONFERECE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES (CHASE), 2018, :69-74
[9]  
Das A, 2018, DES AUT TEST EUROPE, P1217, DOI 10.23919/DATE.2018.8342201
[10]   Unsupervised heart-rate estimation in wearables with Liquid states and a probabilistic readout [J].
Das, Anup ;
Pradhapan, Paruthi ;
Groenendaal, Willemijn ;
Adiraju, Prathyusha ;
Rajan, Raj Thilak ;
Catthoor, Francky ;
Schaafsma, Siebren ;
Krichmar, Jeffrey L. ;
Dutt, Nikil ;
Van Hoof, Chris .
NEURAL NETWORKS, 2018, 99 :134-147