A Framework to Explore Workload-Specific Performance and Lifetime Trade-offs in Neuromorphic Computing

被引:17
作者
Balaji, Adarsha [1 ]
Song, Shihao [1 ]
Das, Anup [1 ]
Dutt, Nikil [2 ]
Krichmar, Jeff [2 ]
Kandasamy, Nagarajan [1 ]
Catthoor, Francky [3 ,4 ]
机构
[1] Drexel Univ, Philadelphia, PA 19104 USA
[2] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[3] IMEC, B-3001 Leuven, Belgium
[4] Katholieke Univ Leuven, B-3000 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Charge pumps; Aging; Neurons; Hardware; Synapses; Negative bias temperature instability; Thermal variables control; Neuromorphic computing; non-voltaile memory (NVM); phase-change memory (PCM); wear-out; negative bias temperature instability (NBTI); spiking neural networks (SNNs); and inter-spike interval (ISI);
D O I
10.1109/LCA.2019.2951507
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neuromorphic hardware with non-volatile memory (NVM) can implement machine learning workload in an energy-efficient manner. Unfortunately, certain NVMs such as phase change memory (PCM) require high voltages for correct operation. These voltages are supplied from an on-chip charge pump. If the charge pump is activated too frequently, its internal CMOS devices do not recover from stress, accelerating their aging and leading to negative bias temperature instability (NBTI) generated defects. Forcefully discharging the stressed charge pump can lower the aging rate of its CMOS devices, but makes the neuromorphic hardware unavailable to perform computations while its charge pump is being discharged. This negatively impacts performance such as latency and accuracy of the machine learning workload being executed. In this letter, we propose a novel framework to exploit workload-specific performance and lifetime trade-offs in neuromorphic computing. Our framework first extracts the precise times at which a charge pump in the hardware is activated to support neural computations within a workload. This timing information is then used with a characterized NBTI reliability model to estimate the charge pumps aging during the workload execution. We use our framework to evaluate workload-specific performance and reliability impacts of using 1) different SNN mapping strategies and 2) different charge pump discharge strategies. We show that our framework can be used by system designers to explore performance and reliability trade-offs early in the design of neuromorphic hardware such that appropriate reliability-oriented design margins can be set.
引用
收藏
页码:149 / 152
页数:4
相关论文
共 13 条
  • [1] [Anonymous], 2019, MLPERF FAIR USEFUL B
  • [2] Mapping Spiking Neural Networks to Neuromorphic Hardware
    Balaji, Adarsha
    Das, Anup
    Wu, Yuefeng
    Huynh, Khanh
    Dell'Anna, Francesco G.
    Indiveri, Giacomo
    Krichmar, Jeffrey L.
    Dutt, Nikil D.
    Schaafsma, Siebren
    Catthoor, Francky
    [J]. IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2020, 28 (01) : 76 - 86
  • [3] Chou YX, 2018, INT CONF CONTR AUTO, P1, DOI 10.1109/ICCAIS.2018.8570697
  • [4] Das A., 2013, CASES
  • [5] Heartbeat Classification in Wearables Using Multi-layer Perceptron and Time-Frequency Joint Distribution of ECG
    Das, Anup
    Catthoor, Francky
    Schaafsma, Siebren
    [J]. 2018 IEEE/ACM INTERNATIONAL CONFERECE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES (CHASE), 2018, : 69 - 74
  • [6] Unsupervised heart-rate estimation in wearables with Liquid states and a probabilistic readout
    Das, Anup
    Pradhapan, Paruthi
    Groenendaal, Willemijn
    Adiraju, Prathyusha
    Rajan, Raj Thilak
    Catthoor, Francky
    Schaafsma, Siebren
    Krichmar, Jeffrey L.
    Dutt, Nikil
    Van Hoof, Chris
    [J]. NEURAL NETWORKS, 2018, 99 : 134 - 147
  • [7] NBTI-Generated Defects in Nanoscaled Devices: Fast Characterization Methodology and Modeling
    Gao, Rui
    Ji, Zhigang
    Manut, Azrif B.
    Zhang, Jian Fu
    Franco, Jacopo
    Hatta, Sharifah Wan Muhamad
    Zhang, Wei Dong
    Kaczer, Ben
    Linten, Dimitri
    Groeseneken, Guido
    [J]. IEEE TRANSACTIONS ON ELECTRON DEVICES, 2017, 64 (10) : 4011 - 4017
  • [8] The Brian simulator
    Goodman, Dan F. M.
    Brette, Romain
    [J]. FRONTIERS IN NEUROSCIENCE, 2009, 3 (02): : 192 - 197
  • [9] Grun S., 2010, ANAL PARALLEL SPIKE, V7
  • [10] He MY, 2018, I COMP CONF WAVELET, P27, DOI 10.1109/ICCWAMTIP.2018.8632562