Efficient Techniques for Extending Service Time for Memristor-based Neural Networks

被引:1
|
作者
Ma, Yu [1 ,2 ,3 ,4 ]
Zhang, Chengrui [1 ,4 ]
Zhou, Pingqiang [1 ,4 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai, Peoples R China
来源
2021 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2021) & 2021 IEEE CONFERENCE ON POSTGRADUATE RESEARCH IN MICROELECTRONICS AND ELECTRONICS (PRIMEASIA 2021) | 2021年
关键词
Memristor; Neural Networks; Drift;
D O I
10.1109/APCCAS51387.2021.9687674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memristor crossbar array (MCA) based accelerators can be used to accelerate neural networks. However, the conductances of memristors change in the inference processes because of drift phenomena. As the weights are represented as the conductances, the weights also change slowly and the accuracy of neural network degrades. In this paper, we propose two techniques to slow down the accuracy degradation by recovering the accuracy after drifting. Firstly, we introduce one label memristor to monitor the drift degree of the crossbar and change the current-result conversion parameter to recover the accuracy. Secondly, we propose an auto-correction technique to correct the conductance of the label memristor. The conductance of the label memristor is used to change the parameter which is used in current-result conversion phase. Experimental results show that our proposed techniques can increase up to 8x high accuracy (> 95%) time and 3x lifetime (> 80%) for MCA based neural networks.
引用
收藏
页码:81 / 84
页数:4
相关论文
共 50 条
  • [1] On Memristor-Based Impulsive Neural Networks with Time-Delay
    Hu, Bin
    Guan, Zhi-Hong
    Liu, Zhi-Wei
    Jiang, Xiao-Wei
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 4748 - 4753
  • [2] Efficient Techniques for Training the Memristor-based Spiking Neural Networks Targeting Better Speed, Energy and Lifetime
    Ma, Yu
    Zhou, Pingqiang
    2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 390 - 395
  • [3] Advances in Memristor-Based Neural Networks
    Xu, Weilin
    Wang, Jingjuan
    Yan, Xiaobing
    FRONTIERS IN NANOTECHNOLOGY, 2021, 3
  • [4] Finite-time synchronization of memristor-based neural networks
    Bao, Haibo
    Park, Ju H.
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1732 - 1735
  • [5] Finite-time synchronization of memristor-based neural networks with mixed delays
    Chen, Chuan
    Li, Lixiang
    Peng, Haipeng
    Yang, Yixian
    Li, Tao
    NEUROCOMPUTING, 2017, 235 : 83 - 89
  • [6] Fixed-time synchronization of inertial memristor-based neural networks with discrete delay
    Chen, Chuan
    Li, Lixiang
    Peng, Haipeng
    Yang, Yixian
    NEURAL NETWORKS, 2019, 109 : 81 - 89
  • [7] Exponential synchronization of memristor-based recurrent neural networks with time delays
    Wu, Ailong
    Zeng, Zhigang
    Zhu, Xusheng
    Zhang, Jine
    NEUROCOMPUTING, 2011, 74 (17) : 3043 - 3050
  • [8] Fixed-time synchronization of the impulsive memristor-based neural networks
    Zhang, Yanlin
    Zhuang, Jinshen
    Xia, Yonghui
    Bai, Yuzhen
    Cao, Jinde
    Gu, Longfei
    COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2019, 77 : 40 - 53
  • [9] Convergence and attractivity of memristor-based cellular neural networks with time delays
    Qin, Sitian
    Wang, Jun
    Xue, Xiaoping
    NEURAL NETWORKS, 2015, 63 : 223 - 233
  • [10] Offline Training for Memristor-based Neural Networks
    Boquet, Guillem
    Macias, Edwar
    Morell, Antoni
    Serrano, Javier
    Miranda, Enrique
    Lopez Vicario, Jose
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1547 - 1551