High Robustness Memristor Neural State Machines

被引:12
作者
Tian, Lei [1 ]
Wang, Yaoyuan [1 ]
Shi, Luping [1 ]
Zhao, Rong [1 ]
机构
[1] Tsinghua Univ, Ctr Brain Inspired Comp Res, Beijing Innovat Ctr Future Chip, Dept Precis Instrument, Beijing 100084, Peoples R China
关键词
memristor; neural state machine; robustness; variation; map search; CELLULAR NONLINEAR NETWORKS; THEORETICAL FOUNDATIONS; DEVICES;
D O I
10.1021/acsaelm.0c00700
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Neural state machines (NSMs) with weight tunable synapses and leaky integrate-and-fire neurons can control the workflow according to the input information and current state, which has attracted increasing attention in handling complex control logic for various applications. The emerging memristor crossbar network provides an opportunity to further develop NSMs due to the unique analog properties, high density, low-power consumption, and high scalability. However, memristors exhibit nonideal features, such as variation, nonlinearity, and asymmetry of the conductance update, which may hinder the implementation of memristors in NSMs. In this paper, we investigate the implementation of a memristor in an NSM and demonstrate a fully memristor neural state machine (MNSM). Nonvolatile and volatile memristors are designed to emulate the synaptic and neuronal behaviors in MNSMs, respectively. Through a map search task, the MNSM not only exhibits strong robustness to the substantial nonideal behaviors of memristors but also benefits from these shortcomings, showing a faster convergence in the training process. This work proves the feasibility of applying memristors in NSMs and the great potential of MNSMs in handling complex control logic, which promotes the further development of NSMs for neuromorphic computing systems.
引用
收藏
页码:3633 / 3642
页数:10
相关论文
共 39 条
  • [21] Perikamana SKM, 2020, WOODH PUBL SER BIOM, P307, DOI 10.1016/B978-0-08-102478-2.00013-1
  • [22] Mastering the game of Go without human knowledge
    Silver, David
    Schrittwieser, Julian
    Simonyan, Karen
    Antonoglou, Ioannis
    Huang, Aja
    Guez, Arthur
    Hubert, Thomas
    Baker, Lucas
    Lai, Matthew
    Bolton, Adrian
    Chen, Yutian
    Lillicrap, Timothy
    Hui, Fan
    Sifre, Laurent
    van den Driessche, George
    Graepel, Thore
    Hassabis, Demis
    [J]. NATURE, 2017, 550 (7676) : 354 - +
  • [23] Neural State Machine for Character-Scene Interactions
    Starke, Sebastian
    Zhang, He
    Komura, Taku
    Saito, Jun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06):
  • [24] Theoretical Foundations of Memristor Cellular Nonlinear Networks: Memcomputing With Bistable-Like Memristors
    Tetzlaff, Ronald
    Ascoli, Alon
    Messaris, Ioannis
    Chua, Leon O.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2020, 67 (02) : 502 - 515
  • [25] Learning Continuous Muscle Control for a Multi-joint Arm by Extending Proximal Policy Optimization with a Liquid State Machine
    Tieck, Juan Camilo Vasquez
    Pogancic, Marin Vlastelica
    Kaiser, Jacques
    Roennau, Arne
    Gewaltig, Marc-Oliver
    Dillmann, Ruediger
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 : 211 - 221
  • [26] Tvardovskii AS, 2019, INT CONF SEMINAR, P102, DOI [10.1109/EDM.2019.8823493, 10.1109/edm.2019.8823493]
  • [27] Nanobatteries in redox-based resistive switches require extension of memristor theory
    Valov, I.
    Linn, E.
    Tappertzhofen, S.
    Schmelzer, S.
    van den Hurk, J.
    Lentz, F.
    Waser, R.
    [J]. NATURE COMMUNICATIONS, 2013, 4
  • [28] Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine
    Wang, Jun
    Song, Jingwei
    Chen, Mingquan
    Yang, Zhi
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2015, 36 (12) : 3144 - 3169
  • [29] SSM: a high-performance scheme for in situ training of imprecise memristor neural networks
    Wang, Yaoyuan
    Wu, Shuang
    Tian, Lei
    Shi, Luping
    [J]. NEUROCOMPUTING, 2020, 407 (407) : 270 - 280
  • [30] Realizing Bidirectional Threshold Switching in Ag/Ta2O5/Pt Diffusive Devices for Selector Applications
    Wang, Yaoyuan
    Zhang, Ziyang
    Li, Huanglong
    Shi, Luping
    [J]. JOURNAL OF ELECTRONIC MATERIALS, 2019, 48 (01) : 517 - 525