Self-adaptive STDP-based learning of a spiking neuron with nanocomposite memristive weights

被引:66
作者
Emelyanov, A., V [1 ,2 ]
Nikiruy, K. E. [1 ,2 ]
Serenko, A., V [1 ]
Sitnikov, A., V [1 ,3 ]
Presnyakov, M. Yu [1 ]
Rybka, R. B. [1 ]
Sboev, A. G. [1 ]
Rylkov, V. V. [1 ,4 ]
Kashkarov, P. K. [1 ,2 ,5 ]
Kovalchuk, M., V [1 ,2 ,5 ]
Demin, V. A. [1 ]
机构
[1] Natl Res Ctr Kurchatov Inst, Moscow 123182, Russia
[2] Moscow Inst Phys & Technol, Dolgoprudnyi 141700, Moscow Region, Russia
[3] Voronezh State Tech Univ, Voronezh 394026, Russia
[4] RAS, Kotelnikov Inst Radio Engn & Elect, Fryazino 141190, Moscow Region, Russia
[5] Lomonosov Moscow State Univ, Fac Phys, Moscow 119991, Russia
基金
俄罗斯基础研究基金会; 俄罗斯科学基金会;
关键词
memristor; nanocomposite; STDP; neuromorphic system; spiking neuron; PLASTICITY; NETWORKS; DEVICE;
D O I
10.1088/1361-6528/ab4a6d
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
Neuromorphic systems consisting of artificial neurons and memristive synapses could provide a much better performance and a significantly more energy-efficient approach to the implementation of different types of neural network algorithms than traditional hardware with the Von-Neumann architecture. However, the memristive weight adjustment in the formal neuromorphic networks by the standard back-propagation techniques suffers from poor device-to-device reproducibility. One of the most promising approaches to overcome this problem is to use local learning rules for spiking neuromorphic architectures which potentially could be adaptive to the variability issue mentioned above. Different kinds of local rules for learning spiking systems are mostly realized on a bio-inspired spike-time-dependent plasticity (STDP) mechanism, which is an improved type of classical Hebbian learning. Whereas the STDP-like mechanism has already been shown to emerge naturally in memristive devices, the demonstration of its self-adaptive learning property, potentially overcoming the variability problem, is more challenging and has yet to be reported. Here we experimentally demonstrate an STDP-based learning protocol that ensures self-adaptation of the memristor resistive states, after only a very few spikes, and makes the plasticity sensitive only to the input signal configuration, but neither to the initial state of the devices nor their device-to-device variability. Then, it is shown that the self-adaptive learning of a spiking neuron with memristive weights on rate-coded patterns could also be realized with hardware-based STDP rules. The experiments have been carried out with nanocomposite-based (Co40Fe40B20)(?)(LiNbO3?y)(100??) memristive structures, but their results are believed to be applicable to a wide range of memristive devices. All the experimental data were supported and extended by numerical simulations. There is a hope that the obtained results pave the way for building up reliable spiking neuromorphic systems composed of partially unreliable analog memristive elements, with a more complex architecture and the capability of unsupervised learning.
引用
收藏
页数:10
相关论文
共 61 条
[1]   Formation of Weighting Coefficients in an Artificial Neural Network Based on the Memristive Effect in Metal-Oxide-Metal Nanostructures [J].
Antonov, I. N. ;
Belov, A. I. ;
Mikhaylov, A. N. ;
Morozov, O. A. ;
Ovchinnikov, P. E. .
JOURNAL OF COMMUNICATIONS TECHNOLOGY AND ELECTRONICS, 2018, 63 (08) :950-957
[2]   Learning through ferroelectric domain dynamics in solid-state synapses [J].
Boyn, Soeren ;
Grollier, Julie ;
Lecerf, Gwendal ;
Xu, Bin ;
Locatelli, Nicolas ;
Fusil, Stephane ;
Girod, Stephanie ;
Carretero, Cecile ;
Garcia, Karin ;
Xavier, Stephane ;
Tomas, Jean ;
Bellaiche, Laurent ;
Bibes, Manuel ;
Barthelemy, Agnes ;
Saighi, Sylvain ;
Garcia, Vincent .
NATURE COMMUNICATIONS, 2017, 8
[3]   Extended memory lifetime in spiking neural networks employing memristive synapses with nonlinear conductance dynamics [J].
Brivio, S. ;
Conti, D. ;
Nair, M., V ;
Frascaroli, J. ;
Covi, E. ;
Ricciardi, C. ;
Indiveri, G. ;
Spiga, S. .
NANOTECHNOLOGY, 2019, 30 (01)
[4]   Cluster synchronization in an array of hybrid coupled neural networks with delay [J].
Cao, Jinde ;
Li, Lulu .
NEURAL NETWORKS, 2009, 22 (04) :335-342
[5]   A 4096-Neuron 1M-Synapse 3.8-pJ/SOP Spiking Neural Network With On-Chip STDP Learning and Sparse Weights in 10-nm FinFET CMOS [J].
Chen, Gregory K. ;
Kumar, Raghavan ;
Sumbul, H. Ekin ;
Knag, Phil C. ;
Krishnamurthy, Ram K. .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2019, 54 (04) :992-1002
[6]   Experimental Demonstration of Feature Extraction and Dimensionality Reduction Using Memristor Networks [J].
Choi, Shinhyun ;
Shin, Jong Hoon ;
Lee, Jihang ;
Sheridan, Patrick ;
Lu, Wei D. .
NANO LETTERS, 2017, 17 (05) :3113-3118
[7]   Hardware implementation of neural network using pre-programmed resistive device for pattern recognition [J].
Choi, Wooseok ;
Moon, Kibong ;
Kwak, Myonghoon ;
Sung, Changhyuck ;
Lee, Jongwon ;
Song, Jeonghwan ;
Park, Jaesung ;
Chekol, Solomon Amsalu ;
Hwang, Hyunsang .
SOLID-STATE ELECTRONICS, 2019, 153 :79-83
[8]   Analog Memristive Synapse in Spiking Networks Implementing Unsupervised Learning [J].
Covi, Erika ;
Brivio, Stefano ;
Serb, Alexander ;
Prodromakis, Themis ;
Fanciulli, Marco ;
Spiga, Sabina .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[9]   A scalable neural chip with synaptic electronics using CMOS integrated memristors [J].
Cruz-Albrecht, Jose M. ;
Derosier, Timothy ;
Srinivasa, Narayan .
NANOTECHNOLOGY, 2013, 24 (38)
[10]  
DEMIN V, 2018, NEUROINFORMATICS, V12, DOI DOI 10.3389/FNINF.2018.00079