A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses

被引:136
作者
Adhikari, Shyam Prasad [1 ]
Kim, Hyongsuk [1 ]
Budhathoki, Ram Kaji [1 ]
Yang, Changju [1 ]
Chua, Leon O. [2 ]
机构
[1] Chonbuk Natl Univ, Div Elect Engn, Jeonju 561756, South Korea
[2] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
基金
新加坡国家研究基金会;
关键词
Chip-in-the-loop; memristor; memristor bridge synapse; neural learning hardware; neural network; random weight change; PERTURBATION; FEEDFORWARD; CHIP;
D O I
10.1109/TCSI.2014.2359717
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Memristor-based circuit architecture for multilayer neural networks is proposed. It is a first of its kind demonstrating successful circuit-based learning for multilayer neural network built with memristors. Though back-propagation algorithm is a powerful learning scheme for multilayer neural networks, its hardware implementation is very difficult due to complexities of the neural synapses and the operations involved in the learning algorithm. In this paper, the circuit of a multilayer neural network is designed with memristor bridge synapses and the learning is realized with a simple learning algorithm called Random Weight Change (RWC). Though RWC algorithm requires more iterations than back-propagation algorithm, we show that a circuit-based learning using RWC is two orders faster than its software counterpart. The method to build a multilayer neural network using memristor bridge synapses and a circuit-based learning architecture of RWC algorithm is proposed. Comparison between software-based and memristor circuit-based learning are presented via simulations.
引用
收藏
页码:215 / 223
页数:9
相关论文
共 26 条
  • [1] Memristor Bridge Synapse-Based Neural Network and Its Learning
    Adhikari, Shyam Prasad
    Yang, Changju
    Kim, Hyongsuk
    Chua, Leon O.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (09) : 1426 - 1435
  • [2] Implementation of Biologically Plausible Spiking Neural Network Models On the Memristor Crossbar-based CMOS/Nano Circuits
    Afifi, A.
    Ayatollahi, A.
    Raissi, F.
    [J]. 2009 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOLS 1 AND 2, 2009, : 563 - +
  • [3] [Anonymous], ADV NEURAL INFORM PR
  • [4] [Anonymous], ADV NEURAL INFORM PR
  • [5] Transient Behaviors of Multiple Memristor Circuits Based on Flux Charge Relationship
    Budhathoki, Ram Kaji
    Sah, Maheshwar P. D.
    Yang, Changju
    Kim, Hyongsuk
    Chua, Leon
    [J]. INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2014, 24 (02):
  • [6] Composite Behavior of Multiple Memristor Circuits
    Budhathoki, Ram Kaji
    Sah, Maheshwar Pd.
    Adhikari, Shyam Prasad
    Kim, Hyongsuk
    Chua, Leon
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2013, 60 (10) : 2688 - 2700
  • [7] Identification and control of induction motor stator currents using fast on-line random training of a neural network
    Burton, B
    Kamran, F
    Harley, RG
    Habetler, TG
    Brooke, MA
    Poddar, R
    [J]. IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 1997, 33 (03) : 697 - 704
  • [8] Neural Learning Circuits Utilizing Nano-Crystalline Silicon Transistors and Memristors
    Cantley, Kurtis D.
    Subramaniam, Anand
    Stiegler, Harvey J.
    Chapman, Richard A.
    Vogel, Eric M.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (04) : 565 - 573
  • [9] Hebbian Learning in Spiking Neural Networks With Nanocrystalline Silicon TFTs and Memristive Synapses
    Cantley, Kurtis D.
    Subramaniam, Anand
    Stiegler, Harvey J.
    Chapman, Richard A.
    Vogel, Eric M.
    [J]. IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2011, 10 (05) : 1066 - 1073
  • [10] Resistance switching memories are memristors
    Chua, Leon
    [J]. APPLIED PHYSICS A-MATERIALS SCIENCE & PROCESSING, 2011, 102 (04): : 765 - 783