A Universal, Analog, In-Memory Computing Primitive for Linear Algebra Using Memristors

被引:14
作者
Mannocci, Piergiulio [1 ]
Pedretti, Giacomo [2 ]
Giannone, Elisabetta [1 ]
Melacarne, Enrico [1 ]
Sun, Zhong [3 ]
Ielmini, Daniele [1 ]
机构
[1] Politecn Milan, Dipartimento Elettron Informaz & Bioingn, I-20133 Milan, Italy
[2] Hewlett Packard Labs, Milpitas, CA 95035 USA
[3] Peking Univ PKU, Sch Integrated Circuits, Inst Artificial Intelligence, Beijing 100871, Peoples R China
基金
欧洲研究理事会;
关键词
Linear systems; Integrated circuit modeling; Linear regression; Mathematical models; Covariance matrices; Bandwidth; SPICE; In-memory computing; resistive memory; hardware accelerator; linear regression; linear systems; LEAST-SQUARES ESTIMATE;
D O I
10.1109/TCSI.2021.3122278
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The increasing demand for data-intensive computing applications, such as artificial intelligence (AI) and more specifically machine learning (ML), raises the need for novel computing hardware architectures capable of massive parallelism in performing core algebraic operations. Among the new paradigms, in-memory computing (IMC) with analogue devices is attracting significant interest for its large-scale integration potential, together with unrivaled speed and energy performance. Here, we present a fully-analogue, universal primitive capable of executing linear algebra operations such as regression, generalized least-square minimization and linear system solution with and without preconditioning. We study the impact of the main circuit parameters on accuracy and bandwidth with analytical closed-form expressions and SPICE simulations. Scaling challenges due to parasitic resistance/capacitance and their impact on key parameters such as bandwidth and accuracy are discussed. Finally, a comparison with existing solvers belonging to the same IMC framework is made to assess advantages and disadvantages of the proposed circuit.
引用
收藏
页码:4889 / 4899
页数:11
相关论文
共 39 条
  • [1] [Anonymous], 2013, INT TECHNOLOGY ROADM
  • [2] [Anonymous], 1989, ANALOG VLSI NEURAL S
  • [3] Low-output-impedance class AB bipolar voltage buffer
    Barthelemy, H
    [J]. ELECTRONICS LETTERS, 1997, 33 (20) : 1662 - 1664
  • [4] A COMPUTATIONAL METHOD FOR THE INDEFINITE QUADRATIC-PROGRAMMING PROBLEM
    BUNCH, JR
    KAUFMAN, L
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 1980, 34 (DEC) : 341 - 370
  • [5] Power-efficient combinatorial optimization using intrinsic noise in memristor Hopfield neural networks
    Cai, Fuxi
    Kumar, Suhas
    Van Vaerenbergh, Thomas
    Sheng, Xia
    Liu, Rui
    Li, Can
    Liu, Zhan
    Foltin, Martin
    Yu, Shimeng
    Xia, Qiangfei
    Yang, J. Joshua
    Beausoleil, Raymond
    Lu, Wei D.
    Strachan, John Paul
    [J]. NATURE ELECTRONICS, 2020, 3 (07) : 409 - 418
  • [6] Modeling and Analysis of Passive Switching Crossbar Arrays
    Fouda, Mohammed E.
    Eltawil, Ahmed M.
    Kurdahi, Fadi
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2018, 65 (01) : 270 - 282
  • [7] Eigenvalue computation in the 20th century
    Golub, GH
    van der Vorst, HA
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2000, 123 (1-2) : 35 - 65
  • [8] An iteration for indefinite systems and its application to the Navier-Stokes equations
    Golub, GH
    Wathen, AJ
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 19 (02) : 530 - 539
  • [9] Horn RA, 2012, MATRIX ANAL
  • [10] Memristor-Based Analog Computation and Neural Network Classification with a Dot Product Engine
    Hu, Miao
    Graves, Catherine E.
    Li, Can
    Li, Yunning
    Ge, Ning
    Montgomery, Eric
    Davila, Noraica
    Jiang, Hao
    Williams, R. Stanley
    Yang, J. Joshua
    Xia, Qiangfei
    Strachan, John Paul
    [J]. ADVANCED MATERIALS, 2018, 30 (09)