Role of synaptic variability in resistive memory-based spiking neural networks with unsupervised learning

被引:15
作者
Ly, Denys R. B. [1 ]
Grossi, Alessandro [1 ]
Fenouillet-Beranger, Claire [1 ]
Nowak, Etienne [1 ]
Querlioz, Damien [2 ]
Vianello, Elisa [1 ]
机构
[1] Univ Grenoble Alpes, CEA, LETI, F-38000 Grenoble, France
[2] Univ Paris Saclay, Univ Paris Sud, Ctr Nanosci & Nanotechnol, CNRS,Orsay C2N, F-91405 Orsay, France
基金
欧盟地平线“2020”;
关键词
resistive switching memory (RRAM); artificial synapse; spiking neural network (SNN); unsupervised learning; conductance variability; FLUCTUATIONS; BRAIN; DEVICES; NOISE;
D O I
10.1088/1361-6463/aad954
中图分类号
O59 [应用物理学];
学科分类号
摘要
Resistive switching memories (RRAMs) have attracted wide interest as adaptive synaptic elements in artificial bio-inspired spiking neural networks (SNNs). These devices suffer from high cycle-to-cycle and cell-to-cell conductance variability, which is usually considered as a big challenge. However, biological synapses are noisy devices and the brain seems in some situations to benefit from the noise. It has been predicted that RRAM-based SNNs are intrinsically robust to synaptic variability. Here, we investigate this robustness based on extensive characterization data: we analyze the role of noise during unsupervised learning by spike-timing dependent plasticity (STDP) for detection in dynamic input data and classification of static input data. Extensive characterizations of multi-kilobits HfO2-based oxide-based RAM (OxRAM) arrays under different programming conditions are presented. We identify the trade-offs between programming conditions, power consumption, conductance variability and endurance features. Finally, the experimental results are used to perform system-level simulations fully calibrated on the experimental data. The results demonstrate that, similarly to biology, SNNs are not only robust to noise but a certain amount of noise can even improve the network performance. OxRAM conductance variability increases the range of synaptic values explored during the learning process. Moreover, the reduction of constraints on the OxRAM conductance variability allows the system to operate at low power programming conditions.
引用
收藏
页数:12
相关论文
共 51 条
  • [1] AN EVALUATION OF CAUSES FOR UNRELIABILITY OF SYNAPTIC TRANSMISSION
    ALLEN, C
    STEVENS, CF
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1994, 91 (22) : 10380 - 10383
  • [2] [Anonymous], IEEE INT EL DEV M
  • [3] [Anonymous], P INT MEM WORKSH MAY
  • [4] [Anonymous], 2017, 2017 IEEE INT MEM WO, DOI [DOI 10.1109/IMW.2017.7939100, 10.1109/IMW.2017.7939100]
  • [5] Deep, Big, Simple Neural Nets for Handwritten Digit Recognition
    Ciresan, Dan Claudiu
    Meier, Ueli
    Gambardella, Luca Maria
    Schmidhuber, Juergen
    [J]. NEURAL COMPUTATION, 2010, 22 (12) : 3207 - 3220
  • [6] A Hybrid CMOS-Memristor Neuromorphic Synapse
    Azghadi, Mostafa Rahimi
    Linares-Barranco, Bernabe
    Abbott, Derek
    Leong, Philip H. W.
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2017, 11 (02) : 434 - 445
  • [7] Synaptic modification by correlated activity: Hebb's postulate revisited
    Bi, GQ
    Poo, MM
    [J]. ANNUAL REVIEW OF NEUROSCIENCE, 2001, 24 : 139 - 166
  • [8] Bichler O, 2013, PROCEEDINGS OF THE 2013 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), P7, DOI 10.1109/NanoArch.2013.6623029
  • [9] Bichler O, 2011, 2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), P859, DOI 10.1109/IJCNN.2011.6033311
  • [10] A compound memristive synapse model for statistical learning through STDP in spiking neural networks
    Bill, Johannes
    Legenstein, Robert
    [J]. FRONTIERS IN NEUROSCIENCE, 2014, 8