Efficient Techniques for Extending Service Time for Memristor-based Neural Networks

被引:1
|
作者
Ma, Yu [1 ,2 ,3 ,4 ]
Zhang, Chengrui [1 ,4 ]
Zhou, Pingqiang [1 ,4 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai, Peoples R China
来源
2021 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2021) & 2021 IEEE CONFERENCE ON POSTGRADUATE RESEARCH IN MICROELECTRONICS AND ELECTRONICS (PRIMEASIA 2021) | 2021年
关键词
Memristor; Neural Networks; Drift;
D O I
10.1109/APCCAS51387.2021.9687674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memristor crossbar array (MCA) based accelerators can be used to accelerate neural networks. However, the conductances of memristors change in the inference processes because of drift phenomena. As the weights are represented as the conductances, the weights also change slowly and the accuracy of neural network degrades. In this paper, we propose two techniques to slow down the accuracy degradation by recovering the accuracy after drifting. Firstly, we introduce one label memristor to monitor the drift degree of the crossbar and change the current-result conversion parameter to recover the accuracy. Secondly, we propose an auto-correction technique to correct the conductance of the label memristor. The conductance of the label memristor is used to change the parameter which is used in current-result conversion phase. Experimental results show that our proposed techniques can increase up to 8x high accuracy (> 95%) time and 3x lifetime (> 80%) for MCA based neural networks.
引用
收藏
页码:81 / 84
页数:4
相关论文
共 50 条
  • [41] Robust Stabilization of Memristor-based Coupled Neural Networks with Time-varying Delays
    Fu, Qianhua
    Cai, Jingye
    Zhong, Shouming
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2019, 17 (10) : 2666 - 2676
  • [42] Adaptive synchronization of memristor-based complex-valued neural networks with time delays
    Xu, Wei
    Zhu, Song
    Fang, Xiaoyu
    Wang, Wei
    NEUROCOMPUTING, 2019, 364 : 119 - 128
  • [43] Passivity analysis for memristor-based recurrent neural networks with discrete and distributed delays
    Zhang, Guodong
    Shen, Yi
    Yin, Quan
    Sun, Junwei
    NEURAL NETWORKS, 2015, 61 : 49 - 58
  • [44] Synchronization control of a class of memristor-based recurrent neural networks
    Wu, Ailong
    Wen, Shiping
    Zeng, Zhigang
    INFORMATION SCIENCES, 2012, 183 (01) : 106 - 116
  • [45] An Efficient Memristor-Based Circuit Implementation of Squeeze-and-Excitation Fully Convolutional Neural Networks
    Chen, Jiadong
    Wu, Yincheng
    Yang, Yin
    Wen, Shiping
    Shi, Kaibo
    Bermak, Amine
    Huang, Tingwen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (04) : 1779 - 1790
  • [46] A Compact Memristor-Based Dynamic Synapse for Spiking Neural Networks
    Hu, Miao
    Chen, Yiran
    Yang, J. Joshua
    Wang, Yu
    Li, Hai
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2017, 36 (08) : 1353 - 1366
  • [47] Strategies to Improve the Accuracy of Memristor-Based Convolutional Neural Networks
    Pan, Wen-Qian
    Chen, Jia
    Kuang, Rui
    Li, Yi
    He, Yu-Hui
    Feng, Gui-Rong
    Duan, Nian
    Chang, Ting-Chang
    Miao, Xiang-Shui
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2020, 67 (03) : 895 - 901
  • [48] Memristor-based neural networks with weight simultaneous perturbation training
    Wang, Chunhua
    Xiong, Lin
    Sun, Jingru
    Yao, Wei
    NONLINEAR DYNAMICS, 2019, 95 (04) : 2893 - 2906
  • [49] Modeling affections with memristor-based associative memory neural networks
    Hu, Xiaofang
    Duan, Shukai
    Chen, Guanrong
    Chen, Ling
    NEUROCOMPUTING, 2017, 223 : 129 - 137
  • [50] Memristor-based neural networks with weight simultaneous perturbation training
    Chunhua Wang
    Lin Xiong
    Jingru Sun
    Wei Yao
    Nonlinear Dynamics, 2019, 95 : 2893 - 2906