Impacts of State Instability and Retention Failure of Filamentary Analog RRAM on the Performance of Deep Neural Network

被引:43
作者
Xiang, Yachen [1 ]
Huang, Peng [1 ,2 ]
Zhao, Yudi [1 ]
Zhao, Meiran [3 ]
Gao, Bin [3 ]
Wu, Huaqiang [3 ]
Qian, He [3 ]
Liu, Xiaoyan [1 ,2 ]
Kang, Jinfeng [1 ,2 ]
机构
[1] Peking Univ, Inst Microelect, Beijing 100871, Peoples R China
[2] Peking Univ, Inst Microelect, Natl Key Lab Sci & Technol Micro Nano Fabricat, Beijing 100871, Peoples R China
[3] Tsinghua Univ, Inst Microelect, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Reliability; Synapses; Neural networks; Analytical models; Resistance; Hardware; Degradation; Deep neural network (DNN); resistive random access memory (RRAM); retention; state instability; ARRAY;
D O I
10.1109/TED.2019.2931135
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this work, an evaluation methodology is proposed to study the impacts of state instability and retention failure of filamentary analog resistive random access memory (FA-RRAM) on the performance of deep neural networks (DNNs). Based on the methodology, an analytic model for the statistical state instability and retention behaviors is applied to evaluate the impacts of the reliability of FA-RRAM on an 11-layer FA-RRAM-based DNN for CIFAR-10 recognition. Simulations indicate that the recognition accuracy of the 11-layer DNN decreases rapidly with the increase of the baking time (t = 10(4)s, 16.3% accuracy loss at 125 degrees C) due to the overlapping among neighboring resistance levels. To mitigate the accuracy loss caused by state instability and retention failure, the optimization method including the optimized synapse cell and the refresh operation scheme is developed. With the optimization method, the robustness of the FA-RRAM-based DNN is enhanced significantly in which no accuracy loss is observed even after 10(7)s (at 125 degrees C, 5 x 10(3) s/refresh).
引用
收藏
页码:4517 / 4522
页数:6
相关论文
共 31 条
  • [1] [Anonymous], 2014, IEDM
  • [2] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [3] Large-scale neural networks implemented with non-volatile memory as the synaptic weight element: comparative performance analysis (accuracy, speed, and power)
    Burr, G. W.
    Narayanan, P.
    Shelby, R. M.
    Sidler, S.
    Boybat, I.
    di Nolfo, C.
    Leblebici, Y.
    [J]. 2015 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2015,
  • [4] Compact Modeling of RRAM Devices and Its Applications in 1T1R and 1S1R Array Design
    Chen, Pai-Yu
    Yu, Shimeng
    [J]. IEEE TRANSACTIONS ON ELECTRON DEVICES, 2015, 62 (12) : 4022 - 4028
  • [5] The Effects of Wenxin Keli on P-Wave Dispersion and Maintenance of Sinus Rhythm in Patients with Paroxysmal Atrial Fibrillation: A Meta-Analysis of Randomized Controlled Trials
    Chen, Yu
    Nie, Shaoping
    Gao, Hai
    Sun, Tao
    Liu, Xiaoqiu
    Teng, Fei
    Xing, Yanhui
    Chen, Wen
    Zhang, Zhenpeng
    Gao, Yonghong
    Wang, Jie
    Xing, Yanwei
    Shang, Hongcai
    [J]. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE, 2013, 2013 : 1 - 9
  • [6] Rescuing Memristor-based Neuromorphic Design with High Defects
    Liu, Chenchen
    Hu, Miao
    Strachan, John Paul
    Li, Hai
    [J]. PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [7] Chiu CC, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), P4774, DOI 10.1109/ICASSP.2018.8462105
  • [8] Ultra-Low-Energy Three-Dimensional Oxide-Based Electronic Synapses for Implementation of Robust High-Accuracy Neuromorphic Computation Systems
    Gao, Bin
    Bi, Yingjie
    Chen, Hong-Yu
    Liu, Rui
    Huang, Peng
    Chen, Bing
    Liu, Lifeng
    Liu, Xiaoyan
    Yu, Shimeng
    Wong, H. -S. Philip
    Kang, Jinfeng
    [J]. ACS NANO, 2014, 8 (07) : 6998 - 7004
  • [9] Huang P, 2018, INT EL DEVICES MEET
  • [10] Compact Model of HfOX-Based Electronic Synaptic Devices for Neuromorphic Computing
    Huang, Peng
    Zhu, Dongbin
    Chen, Sijie
    Zhou, Zheng
    Chen, Zhe
    Gao, Bin
    Liu, Lifeng
    Liu, Xiaoyan
    Kang, Jinfeng
    [J]. IEEE TRANSACTIONS ON ELECTRON DEVICES, 2017, 64 (02) : 614 - 621