A Framework to Explore Workload-Specific Performance and Lifetime Trade-offs in Neuromorphic Computing

被引:19
作者
Balaji, Adarsha [1 ]
Song, Shihao [1 ]
Das, Anup [1 ]
Dutt, Nikil [2 ]
Krichmar, Jeff [2 ]
Kandasamy, Nagarajan [1 ]
Catthoor, Francky [3 ,4 ]
机构
[1] Drexel Univ, Philadelphia, PA 19104 USA
[2] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[3] IMEC, B-3001 Leuven, Belgium
[4] Katholieke Univ Leuven, B-3000 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Charge pumps; Aging; Neurons; Hardware; Synapses; Negative bias temperature instability; Thermal variables control; Neuromorphic computing; non-voltaile memory (NVM); phase-change memory (PCM); wear-out; negative bias temperature instability (NBTI); spiking neural networks (SNNs); and inter-spike interval (ISI);
D O I
10.1109/LCA.2019.2951507
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neuromorphic hardware with non-volatile memory (NVM) can implement machine learning workload in an energy-efficient manner. Unfortunately, certain NVMs such as phase change memory (PCM) require high voltages for correct operation. These voltages are supplied from an on-chip charge pump. If the charge pump is activated too frequently, its internal CMOS devices do not recover from stress, accelerating their aging and leading to negative bias temperature instability (NBTI) generated defects. Forcefully discharging the stressed charge pump can lower the aging rate of its CMOS devices, but makes the neuromorphic hardware unavailable to perform computations while its charge pump is being discharged. This negatively impacts performance such as latency and accuracy of the machine learning workload being executed. In this letter, we propose a novel framework to exploit workload-specific performance and lifetime trade-offs in neuromorphic computing. Our framework first extracts the precise times at which a charge pump in the hardware is activated to support neural computations within a workload. This timing information is then used with a characterized NBTI reliability model to estimate the charge pumps aging during the workload execution. We use our framework to evaluate workload-specific performance and reliability impacts of using 1) different SNN mapping strategies and 2) different charge pump discharge strategies. We show that our framework can be used by system designers to explore performance and reliability trade-offs early in the design of neuromorphic hardware such that appropriate reliability-oriented design margins can be set.
引用
收藏
页码:149 / 152
页数:4
相关论文
共 13 条
[1]  
[Anonymous], 2019, MLPERF FAIR USEFUL B
[2]   Mapping Spiking Neural Networks to Neuromorphic Hardware [J].
Balaji, Adarsha ;
Das, Anup ;
Wu, Yuefeng ;
Huynh, Khanh ;
Dell'Anna, Francesco G. ;
Indiveri, Giacomo ;
Krichmar, Jeffrey L. ;
Dutt, Nikil D. ;
Schaafsma, Siebren ;
Catthoor, Francky .
IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2020, 28 (01) :76-86
[3]  
Chou YX, 2018, INT CONF CONTR AUTO, P1, DOI 10.1109/ICCAIS.2018.8570697
[4]  
Das A., 2013, CASES
[5]   Heartbeat Classification in Wearables Using Multi-layer Perceptron and Time-Frequency Joint Distribution of ECG [J].
Das, Anup ;
Catthoor, Francky ;
Schaafsma, Siebren .
2018 IEEE/ACM INTERNATIONAL CONFERECE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES (CHASE), 2018, :69-74
[6]   Unsupervised heart-rate estimation in wearables with Liquid states and a probabilistic readout [J].
Das, Anup ;
Pradhapan, Paruthi ;
Groenendaal, Willemijn ;
Adiraju, Prathyusha ;
Rajan, Raj Thilak ;
Catthoor, Francky ;
Schaafsma, Siebren ;
Krichmar, Jeffrey L. ;
Dutt, Nikil ;
Van Hoof, Chris .
NEURAL NETWORKS, 2018, 99 :134-147
[7]   NBTI-Generated Defects in Nanoscaled Devices: Fast Characterization Methodology and Modeling [J].
Gao, Rui ;
Ji, Zhigang ;
Manut, Azrif B. ;
Zhang, Jian Fu ;
Franco, Jacopo ;
Hatta, Sharifah Wan Muhamad ;
Zhang, Wei Dong ;
Kaczer, Ben ;
Linten, Dimitri ;
Groeseneken, Guido .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 2017, 64 (10) :4011-4017
[8]   The Brian simulator [J].
Goodman, Dan F. M. ;
Brette, Romain .
FRONTIERS IN NEUROSCIENCE, 2009, 3 (02) :192-197
[9]  
Grun S., 2010, ANAL PARALLEL SPIKE, V7
[10]  
He MY, 2018, I COMP CONF WAVELET, P27, DOI 10.1109/ICCWAMTIP.2018.8632562