Analyzing the Impact of Memristor Variability on Crossbar Implementation of Regression Algorithms With Smart Weight Update Pulsing Techniques

被引:12
作者
Afshari, Sahra [1 ]
Musisi-Nkambwe, Mirembe [1 ]
Esqueda, Ivan Sanchez [1 ]
机构
[1] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85287 USA
基金
美国国家科学基金会;
关键词
Memristors; Integrated circuit modeling; Training; Programming; Mathematical models; Convergence; Computer architecture; RRAM; crossbar array; variability; machine learning; stochastic regression; RESISTIVE RAM; IN-MEMORY; RRAM; DEVICE; 1T1R;
D O I
10.1109/TCSI.2022.3144240
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents an extensive study of linear and logistic regression algorithms implemented with 1T1R memristor crossbars arrays. Using a sophisticated simulation platform that wraps circuit-level simulations of 1T1R crossbars and physics-based models of RRAM (memristors), we elucidate the impact of device variability on algorithm accuracy, convergence rate and precision. Moreover, a smart pulsing strategy is proposed for practical implementation of synaptic weight updates that can accelerate training in real crossbar architectures. Stochastic multi-variable linear regression shows robustness to memristor variability in terms of prediction accuracy but reveals impact on convergence rate and precision. Similarly, the stochastic logistic regression crossbar implementation reveals immunity to memristor variability as determined by negligible effects on image classification accuracy but indicates an impact on training performance manifested as reduced convergence rate and degraded precision.
引用
收藏
页码:2025 / 2034
页数:10
相关论文
共 55 条
[21]  
Hong XiaoLiang., 2018, Journal of Physics D: Applied Physics, DOI DOI 10.1088/1361-6463/AAC2B4
[22]   Resistive switching memories based on metal oxides: mechanisms, reliability and scaling [J].
Ielmini, Daniele .
SEMICONDUCTOR SCIENCE AND TECHNOLOGY, 2016, 31 (06)
[23]   Impact of Synaptic Device Variations on Classification Accuracy in a Binarized Neural Network [J].
Kim, Sungho ;
Kim, Hee-Dong ;
Choi, Sung-Jin .
SCIENTIFIC REPORTS, 2019, 9 (1)
[24]   Backpropagation and the brain [J].
Lillicrap, Timothy P. ;
Santoro, Adam ;
Marris, Luke ;
Akerman, Colin J. ;
Hinton, Geoffrey .
NATURE REVIEWS NEUROSCIENCE, 2020, 21 (06) :335-346
[25]   The Origin of CBRAM With High Linearity, On/Off Ratio, and State Number for Neuromorphic Computing [J].
Liu, Yanming ;
Gao, Jialu ;
Wu, Fan ;
Tian, He ;
Ren, Tian-Ling .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 2021, 68 (05) :2568-2571
[26]   Role of the electrode metal, waveform geometry, temperature, and postdeposition treatment on SET and RESET of HfO2-based resistive random access memory 1R-cells: Experimental aspects [J].
Lorenzi, Paolo ;
Rao, Rosario ;
Irrera, Fernanda .
JOURNAL OF VACUUM SCIENCE & TECHNOLOGY B, 2015, 33 (01)
[27]   Reliability of CMOS integrated memristive HfO2 arrays with respect to neuromorphic computing [J].
Mahadevaiah, M. K. ;
Perez, E. ;
Wenger, Ch. ;
Grossi, A. ;
Zambelli, C. ;
Olivo, P. ;
Zahari, F. ;
Kohlstedt, H. ;
Ziegler, M. .
2019 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2019,
[28]   Exploiting Oxide Based Resistive RAM Variability for Bayesian Neural Network Hardware Design [J].
Malhotra, Akul ;
Lu, Sen ;
Yang, Kezhou ;
Sengupta, Abhronil .
IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2020, 19 :328-331
[29]  
Marinella M., 2019, SAND20198314C677565
[30]   On the design and analysis of a compact array with 1T1R RRAM memory element [J].
Mbarek, Khaoula ;
Rziga, Faten Ouaja ;
Ghedira, Sami ;
Besbes, Kamel .
ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2020, 102 (01) :27-37