Memristor Neural Network Training with Clock Synchronous Neuromorphic System

被引:12
|
作者
Jo, Sumin [1 ]
Sun, Wookyung [1 ]
Kim, Bokyung [1 ]
Kim, Sunhee [2 ]
Park, Junhee [1 ]
Shin, Hyungsoon [1 ]
机构
[1] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
[2] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan 31066, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic system; Hebbian training; guide training; memristor; image classification; CIRCUIT; DEVICE; BRAIN; MODEL;
D O I
10.3390/mi10060384
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Forgetting memristor based neuromorphic system for pattern training and recognition
    Zhang, Peijian
    Li, Chuandong
    Huang, Tingwen
    Chen, Ling
    Chen, Yiran
    NEUROCOMPUTING, 2017, 222 : 47 - 53
  • [2] Multilevel switching memristor by compliance current adjustment for off-chip training of neuromorphic system
    Kim, Tae-Hyeon
    Kim, Sungjoon
    Hong, Kyungho
    Park, Jinwoo
    Hwang, Yeongjin
    Park, Byung-Gook
    Kim, Hyungjin
    CHAOS SOLITONS & FRACTALS, 2021, 153 (153)
  • [3] Memristor Crossbar Architecture for Synchronous Neural Networks
    Starzyk, Janusz A.
    Basawaraj
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2014, 61 (08) : 2390 - 2401
  • [4] Flexible memristor based neuromorphic system for implementing multi-layer neural network algorithms
    Yakopcic, Chris
    Hasan, Raqibul
    Taha, Tarek M.
    INTERNATIONAL JOURNAL OF PARALLEL EMERGENT AND DISTRIBUTED SYSTEMS, 2018, 33 (04) : 408 - 429
  • [5] Optimization of Deep Neural Network for Neuromorphic System
    Lee, Jae Eun
    Lee, Chul Jun
    Lee, Dae Seok
    Kim, Dong Wook
    Seo, Young Ho
    2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019), 2019, : 430 - 431
  • [6] A memristor-based neural network circuit with synchronous weight adjustment
    Yang, Le
    Zeng, Zhigang
    Shi, Xinming
    NEUROCOMPUTING, 2019, 363 : 114 - 124
  • [7] A Functional Hybrid Memristor Crossbar-Array/CMOS System for Data Storage and Neuromorphic Applications
    Kim, Kuk-Hwan
    Gaba, Siddharth
    Wheeler, Dana
    Cruz-Albrecht, Jose M.
    Hussain, Tahir
    Srinivasa, Narayan
    Lu, Wei
    NANO LETTERS, 2012, 12 (01) : 389 - 395
  • [8] Low-power hybrid memristor-CMOS spiking neuromorphic STDP learning system
    Maranhao, Gabriel
    Guimaraes, Janaina Goncalves
    IET CIRCUITS DEVICES & SYSTEMS, 2021, 15 (03) : 237 - 250
  • [9] Memristor-based Neuromorphic Implementations for Artificial Neural Networks
    Zhao, Chun
    Zhou, Guang You
    Zhao, Ce Zhou
    Yang, Li
    Man, Ka Lok
    Lim, Eng Gee
    2018 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2018, : 174 - 175
  • [10] Memristor-based spiking neural network with online reinforcement learning
    Vlasov, Danila
    Minnekhanov, Anton
    Rybka, Roman
    Davydov, Yury
    Sboev, Alexander
    Serenko, Alexey
    Ilyasov, Alexander
    Demin, Vyacheslav
    NEURAL NETWORKS, 2023, 166 : 512 - 523