Efficient Techniques for Extending Service Time for Memristor-based Neural Networks

被引:1
|
作者
Ma, Yu [1 ,2 ,3 ,4 ]
Zhang, Chengrui [1 ,4 ]
Zhou, Pingqiang [1 ,4 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai, Peoples R China
来源
2021 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2021) & 2021 IEEE CONFERENCE ON POSTGRADUATE RESEARCH IN MICROELECTRONICS AND ELECTRONICS (PRIMEASIA 2021) | 2021年
关键词
Memristor; Neural Networks; Drift;
D O I
10.1109/APCCAS51387.2021.9687674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memristor crossbar array (MCA) based accelerators can be used to accelerate neural networks. However, the conductances of memristors change in the inference processes because of drift phenomena. As the weights are represented as the conductances, the weights also change slowly and the accuracy of neural network degrades. In this paper, we propose two techniques to slow down the accuracy degradation by recovering the accuracy after drifting. Firstly, we introduce one label memristor to monitor the drift degree of the crossbar and change the current-result conversion parameter to recover the accuracy. Secondly, we propose an auto-correction technique to correct the conductance of the label memristor. The conductance of the label memristor is used to change the parameter which is used in current-result conversion phase. Experimental results show that our proposed techniques can increase up to 8x high accuracy (> 95%) time and 3x lifetime (> 80%) for MCA based neural networks.
引用
收藏
页码:81 / 84
页数:4
相关论文
共 50 条
  • [21] State estimation for memristor-based neural networks with time-varying delays
    Wei, Hongzhi
    Li, Ruoxia
    Chen, Chunrong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2015, 6 (02) : 213 - 225
  • [22] Finite-Time Stability of Delayed Memristor-Based Fractional-Order Neural Networks
    Chen, Chongyang
    Zhu, Song
    Wei, Yongchang
    Chen, Chongyang
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) : 1607 - 1616
  • [23] State estimation for memristor-based neural networks with time-varying delays
    Hongzhi Wei
    Ruoxia Li
    Chunrong Chen
    International Journal of Machine Learning and Cybernetics, 2015, 6 : 213 - 225
  • [24] Dissipativity Research on Memristor-based Neural Networks with Time-varying Delays
    Zhang F.
    Li Z.
    Li, Zhi (zhli@xidian.edu.cn), 1600, Sichuan University (49): : 129 - 136
  • [25] Equilibrium Propagation for Memristor-Based Recurrent Neural Networks
    Zoppo, Gianluca
    Marrone, Francesco
    Corinto, Fernando
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [26] Fixed-time synchronization of delayed memristor-based recurrent neural networks
    Cao, Jinde
    Li, Ruoxia
    SCIENCE CHINA-INFORMATION SCIENCES, 2017, 60 (03)
  • [27] Memristor-based Neuromorphic Implementations for Artificial Neural Networks
    Zhao, Chun
    Zhou, Guang You
    Zhao, Ce Zhou
    Yang, Li
    Man, Ka Lok
    Lim, Eng Gee
    2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 174 - 175
  • [28] Equilibrium Propagation and (Memristor-based) Oscillatory Neural Networks
    Zoppo, Gianluca
    Marrone, Francesco
    Bonnin, Michele
    Corinto, Fernando
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 639 - 643
  • [29] Memristor-based chaotic neural networks for associative memory
    Shukai Duan
    Yi Zhang
    Xiaofang Hu
    Lidan Wang
    Chuandong Li
    Neural Computing and Applications, 2014, 25 : 1437 - 1445
  • [30] Memristor-Based Circuit Design for Multilayer Neural Networks
    Zhang, Yang
    Wang, Xiaoping
    Friedman, Eby G.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2018, 65 (02) : 677 - 686