Memristor Neural Network Training with Clock Synchronous Neuromorphic System

被引:12
|
作者
Jo, Sumin [1 ]
Sun, Wookyung [1 ]
Kim, Bokyung [1 ]
Kim, Sunhee [2 ]
Park, Junhee [1 ]
Shin, Hyungsoon [1 ]
机构
[1] Ewha Womans Univ, Dept Elect & Elect Engn, Seoul 03760, South Korea
[2] Sangmyung Univ, Dept Syst Semicond Engn, Cheonan 31066, South Korea
基金
新加坡国家研究基金会;
关键词
neuromorphic system; Hebbian training; guide training; memristor; image classification; CIRCUIT; DEVICE; BRAIN; MODEL;
D O I
10.3390/mi10060384
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Memristor-based Bayesian spiking neural network for IBD diagnosis
    Li, Xiaowen
    Wu, Qiqiao
    Chen, Yuanwen
    Jin, Yang
    Ma, Jianxia
    Yang, Jianguo
    KNOWLEDGE-BASED SYSTEMS, 2024, 300
  • [42] Fault Tolerance of Memristor-Based Perceptron Network for Neural Interface
    Shchanikov, Sergey
    Bordanov, Ilya
    Zuev, Anton
    Danilin, Sergey
    Korolev, Dmitry
    Belov, Alexey
    Mikhaylov, Alexey
    BIONANOSCIENCE, 2021, 11 (01) : 84 - 90
  • [43] Memristor-Based Design of Sparse Compact Convolutional Neural Network
    Wen, Shiping
    Wei, Huaqiang
    Yan, Zheng
    Guo, Zhenyuan
    Yang, Yin
    Huang, Tingwen
    Chen, Yiran
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (03): : 1431 - 1440
  • [44] Fault Tolerance of Memristor-Based Perceptron Network for Neural Interface
    Sergey Shchanikov
    Ilya Bordanov
    Anton Zuev
    Sergey Danilin
    Dmitry Korolev
    Alexey Belov
    Alexey Mikhaylov
    BioNanoScience, 2021, 11 : 84 - 90
  • [45] Research Progress on Chaos, Memory and Neural Network Circuits Based on Memristor
    Wang Chunhua
    Lin Hairong
    Sun Jingru
    Zhou Ling
    Zhou Chao
    Deng Quanli
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (04) : 795 - 810
  • [46] Memristor Neural Network Circuit Based on Operant Conditioning With Immediacy and Satiety
    Sun, Junwei
    Wang, Yangyang
    Liu, Peng
    Wang, Yanfeng
    IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2022, 16 (06) : 1095 - 1105
  • [47] Offline Training for Memristor-based Neural Networks
    Boquet, Guillem
    Macias, Edwar
    Morell, Antoni
    Serrano, Javier
    Miranda, Enrique
    Lopez Vicario, Jose
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1547 - 1551
  • [48] C-elegans Neuromorphic Neural Network Exhibiting Undulating Locomotion
    Agarwal, Nikita
    Mehta, Neil
    Parker, Alice C.
    Ashouri, Karam
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 3912 - 3921
  • [49] Memristor-Based Multilayer Neural Networks With Online Gradient Descent Training
    Soudry, Daniel
    Di Castro, Dotan
    Gal, Asaf
    Kolodny, Avinoam
    Kvatinsky, Shahar
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (10) : 2408 - 2421
  • [50] Hybrid CMOS/memristor crossbar structure for implementing hopfield neural network
    Molahasani Majdabadi, Mahdiyar
    Shamsi, Jafar
    Baradaran Shokouhi, Shahriar
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2021, 107 (02) : 249 - 261