Properties of associative memory analog neural networks with asymmetric synaptic couplings

被引:9
作者
Yoshioka, M
Shiino, M
机构
[1] Department of Applied Physics, Tokyo Institute of Technology, Tokyo, 152, Ohokayama Meguro-ku
来源
PHYSICAL REVIEW E | 1997年 / 55卷 / 06期
关键词
D O I
10.1103/PhysRevE.55.7401
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
Using the self-consistent signal-to-noise analysis, we study fully connected analog neural networks having asymmetric synaptic couplings and positive-valued nonmonotonic transfer functions. Asymmetric synaptic couplings we assume are based on random patterns with bias a and given by J(ij)=(1/N)Sigma(mu){(xi(i)(mu)-a)(xi(j)(mu)-a)+(b/root N)(xi(i)(mu)-a)+c(xi(j)(mu)-a)+(d/N)}, where N is the number of neurons. We find that the synaptic interaction term of memorizing the postsynaptic activity (b term) and that of the presynaptic activity (c term) respectively, give rise to renormalized noise and a renormalized pattern-dependent but neuron-independent component in the local field of neurons, with the latter making the network behavior sample dependent. An enhancement of the storage capacity and the super retrieval phase due to the use of nonmonotonic transfer functions are shown to occur as a result of renormalization of noise even in the presence of the asymmetric synaptic couplings.
引用
收藏
页码:7401 / 7413
页数:13
相关论文
共 30 条
[1]  
Amit D., 1989, Modelling Brain Function: the World of Attractor Neural Networks
[2]   STORING INFINITE NUMBERS OF PATTERNS IN A SPIN-GLASS MODEL OF NEURAL NETWORKS [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
PHYSICAL REVIEW LETTERS, 1985, 55 (14) :1530-1533
[3]   QUANTITATIVE STUDY OF ATTRACTOR NEURAL NETWORKS RETRIEVING AT LOW SPIKE RATES .2. LOW-RATE RETRIEVAL IN SYMMETRICAL NETWORKS [J].
AMIT, DJ ;
TSODYKS, MV .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1991, 2 (03) :275-294
[4]   STATISTICAL-MECHANICS OF NEURAL NETWORKS NEAR SATURATION [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
ANNALS OF PHYSICS, 1987, 173 (01) :30-67
[5]  
[Anonymous], 1991, MODELS NEURAL NETWOR
[6]   SYMMETRY-BREAKING IN NONMONOTONIC NEURAL NETWORKS [J].
BOFFETTA, G ;
MONASSON, R ;
ZECCHINA, R .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1993, 26 (12) :L507-L513
[7]   ABSOLUTE STABILITY OF GLOBAL PATTERN-FORMATION AND PARALLEL MEMORY STORAGE BY COMPETITIVE NEURAL NETWORKS [J].
COHEN, MA ;
GROSSBERG, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :815-826
[8]   RETRIEVAL PROPERTIES OF ANALOG NEURAL NETWORKS AND THE NONMONOTONICITY OF TRANSFER-FUNCTIONS [J].
FUKAI, T ;
KIM, JH ;
SHIINO, M .
NEURAL NETWORKS, 1995, 8 (03) :391-404
[9]   LARGE SUPPRESSION OF SPURIOUS STATES IN NEURAL NETWORKS OF NONLINEAR ANALOG NEURONS [J].
FUKAI, T ;
SHIINO, M .
PHYSICAL REVIEW A, 1990, 42 (12) :7459-7466
[10]  
HEBB DO, 1949, ORG BEHAVIOR