Memristor Bridge Synapse-Based Neural Network and Its Learning

被引:287
作者
Adhikari, Shyam Prasad [1 ]
Yang, Changju [1 ]
Kim, Hyongsuk [1 ]
Chua, Leon O. [2 ]
机构
[1] Chonbuk Natl Univ, Div Elect Engn, Jeonju 561756, South Korea
[2] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
基金
新加坡国家研究基金会;
关键词
Chip-in-the-loop; memristor; memristor bridge synapse; neural network; HARDWARE; IMPLEMENTATION; CHIP; PERTURBATION; CIRCUIT;
D O I
10.1109/TNNLS.2012.2204770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Analog hardware architecture of a memristor bridge synapse-based multilayer neural network and its learning scheme is proposed. The use of memristor bridge synapse in the proposed architecture solves one of the major problems, regarding nonvolatile weight storage in analog neural network implementations. To compensate for the spatial nonuniformity and nonideal response of the memristor bridge synapse, a modified chip-in-the-loop learning scheme suitable for the proposed neural network architecture is also proposed. In the proposed method, the initial learning is conducted in software, and the behavior of the software-trained network is learned by the hardware network by learning each of the single-layered neurons of the network independently. The forward calculation of the single-layered neuron learning is implemented on circuit hardware, and followed by a weight updating phase assisted by a host computer. Unlike conventional chip-in-the-loop learning, the need for the readout of synaptic weights for calculating weight updates in each epoch is eliminated by virtue of the memristor bridge synapse and the proposed learning scheme. The hardware architecture along with the successful implementation of proposed learning on a three-bit parity network, and on a car detection network is also presented.
引用
收藏
页码:1426 / 1435
页数:10
相关论文
共 33 条
  • [1] Implementation of Biologically Plausible Spiking Neural Network Models On the Memristor Crossbar-based CMOS/Nano Circuits
    Afifi, A.
    Ayatollahi, A.
    Raissi, F.
    [J]. 2009 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOLS 1 AND 2, 2009, : 563 - +
  • [2] [Anonymous], P IEEE INT C SYST MA
  • [3] Neural Learning Circuits Utilizing Nano-Crystalline Silicon Transistors and Memristors
    Cantley, Kurtis D.
    Subramaniam, Anand
    Stiegler, Harvey J.
    Chapman, Richard A.
    Vogel, Eric M.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (04) : 565 - 573
  • [4] MEMRISTOR - MISSING CIRCUIT ELEMENT
    CHUA, LO
    [J]. IEEE TRANSACTIONS ON CIRCUIT THEORY, 1971, CT18 (05): : 507 - +
  • [5] Artificial neural networks: a review of commercial hardware
    Dias, FM
    Antunes, A
    Mota, AM
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2004, 17 (08) : 945 - 952
  • [6] Draghici S, 2000, Int J Neural Syst, V10, P19, DOI 10.1142/S0129065700000041
  • [7] Conic Section Function Neural Network Circuitry for Offline Signature Recognition
    Erkmen, Burcu
    Kahraman, Nihan
    Vural, Revna Acar
    Yildirim, Tulay
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (04): : 667 - 672
  • [8] Fawcett T, 2004, ROC GRAPHS NOTES PRA
  • [9] Control of a nonholonomic mobile robot using neural networks
    Fierro, R
    Lewis, FL
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 589 - 600
  • [10] Graf H.P., 1987, AIP C P NEURAL NETWO, P182