Enhancing Reliability of Analog Neural Network Processors

被引:30
作者
Moon, Suhong [1 ]
Shin, Kwanghyun [1 ]
Jeon, Dongsuk [1 ]
机构
[1] Seoul Natl Univ, Grad Sch Convergence Sci & Technol, Seoul 08826, South Korea
基金
新加坡国家研究基金会;
关键词
Analog computing; binarized neural network (BNN); process variation compensation;
D O I
10.1109/TVLSI.2019.2893256
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, analog and mixed-signal neural network processors have been extensively studied due to their better energy efficiency and small footprint. However, analog computing is more vulnerable to circuit nonidealities such as process variation than their digital counterparts. On-chip calibration circuits can be adopted to measure and compensate for those effects, but it leads to unavoidable area and power overheads. In this brief, we propose a variation and noise-tolerant learning algorithm and postsilicon process variation compensation technique which does not require any additional monitoring circuitry. The proposed techniques reduce the accuracy degradation in the corrupted fully connected network down to 1% under large amount of variations including 10% unit capacitor mismatch, 8-mVrms comparator noise and 20-mV(rms) comparator offset.
引用
收藏
页码:1455 / 1459
页数:5
相关论文
共 16 条
  • [1] [Anonymous], 2015, ARXIV PREPRINT ARXIV
  • [2] [Anonymous], 2017, COMMUN ACM, DOI DOI 10.1145/3065386
  • [3] [Anonymous], 2015, ADDING GRADIENT NOIS
  • [4] [Anonymous], P ADV NEUR INF PROC
  • [5] Bankman D, 2018, ISSCC DIG TECH PAP I, P222, DOI 10.1109/ISSCC.2018.8310264
  • [6] Chen YH, 2016, ISSCC DIG TECH PAP I, V59, P262, DOI 10.1109/ISSCC.2016.7418007
  • [7] Han S., 2015, P 28 INT C NEURAL IN, P1135, DOI DOI 10.5555/2969239.2969366
  • [8] EIE: Efficient Inference Engine on Compressed Deep Neural Network
    Han, Song
    Liu, Xingyu
    Mao, Huizi
    Pu, Jing
    Pedram, Ardavan
    Horowitz, Mark A.
    Dally, William J.
    [J]. 2016 ACM/IEEE 43RD ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA), 2016, : 243 - 254
  • [9] Hinton Geoffrey, 2014, P NEUR INF PROC SYST
  • [10] Hubara I, 2016, ADV NEUR IN, V29