Self-Organization in Autonomous, Recurrent, Firing-Rate CrossNets With Quasi-Hebbian Plasticity

被引:4
作者
Walls, Thomas John [1 ]
Likharev, Konstantin K. [2 ]
机构
[1] Naval Res Lab, Washington, DC 20375 USA
[2] SUNY Stony Brook, Stony Brook, NY 11794 USA
关键词
Adaptation; CrossNets; graphical processing unit (GPU); memristors; neuromorphic networks; plasticity; self-organization;
D O I
10.1109/TNNLS.2013.2280904
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We have performed extensive numerical simulations of the autonomous evolution of memristive neuromorphic networks (CrossNets) with the recurrent InBar topology. The synaptic connections were assumed to have the quasi-Hebbian plasticity that may be naturally implemented using a stochastic multiplication technique. When somatic gain g exceeds its critical value g(t), the trivial fixed point of the system becomes unstable, and it enters a self-excitory transient process that eventually leads to a stable static state with equal magnitudes of all the action potentials x(j) and synaptic weights w(jk). However, even in the static state, the spatial distribution of the action potential signs and their correlation with the distribution of initial values x(j)(0) may be rather complicated because of the activation function's nonlinearity. We have quantified such correlation as a function of g, cell connectivity M, and plasticity rate., for a random distribution of initial values of x(j) and w(jk), by numerical simulation of network dynamics, using a high-performance graphical processing unit system. Most interestingly, the autocorrelation function of action potentials is a nonmonotonic function of g because of a specific competition between self-excitation of the potentials and self-adaptation of synaptic weights.
引用
收藏
页码:819 / 824
页数:7
相关论文
共 16 条
[1]   Pattern classification by memristive crossbar circuits using ex situ and in situ training [J].
Alibart, Fabien ;
Zamanidoost, Elham ;
Strukov, Dmitri B. .
NATURE COMMUNICATIONS, 2013, 4
[2]   High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm [J].
Alibart, Fabien ;
Gao, Ligang ;
Hoskins, Brian D. ;
Strukov, Dmitri B. .
NANOTECHNOLOGY, 2012, 23 (07)
[3]  
[Anonymous], P IEEE INT JOINT C N
[4]   MEMRISTOR - MISSING CIRCUIT ELEMENT [J].
CHUA, LO .
IEEE TRANSACTIONS ON CIRCUIT THEORY, 1971, CT18 (05) :507-+
[5]  
Dayan P., 2001, Theoretical neuroscience: computational and mathematical modeling of neural systems
[6]  
Hertz J., 1991, Introduction to the theory of neural computation
[7]   Dedication [J].
Kim, Kyoung-Woong .
ENVIRONMENTAL GEOCHEMISTRY AND HEALTH, 2012, 34 :1-1
[8]  
Lee J. H., 2006, ADV NEURAL INFORM PR, V18, P755
[9]   Defect-tolerant nanoelectronic pattern classifiers [J].
Lee, Jung Hoon ;
Likharev, Konstantin K. .
INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 2007, 35 (03) :239-264
[10]   CrossNets: Neuromorphic Hybrid CMOS/Nanoelectronic Networks [J].
Likharev, Konstantin K. .
SCIENCE OF ADVANCED MATERIALS, 2011, 3 (03) :322-331