A simple neural network exhibiting selective activation of neuronal ensembles: From winner-take-all to winners-share-all

被引:147
作者
Fukai, T [1 ]
Tanaka, S [1 ]
机构
[1] RIKEN, LAB NEURAL MODELING, FRONTIER RES PROGRAM, WAKO, SAITAMA 35101, JAPAN
关键词
D O I
10.1162/neco.1997.9.1.77
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A neuroecological equation of the Lotka-Volterra type for mean firing rate is derived from the conventional membrane dynamics of a neural network with lateral inhibition and self-inhibition. Neural selection mechanisms employed by the competitive neural network receiving external inputs are studied with analytic and numerical calculations. A remarkable finding is that the strength of lateral inhibition relative to that of self-inhibition is crucial for determining the steady states of the network among three qualitatively different types of behavior. Equal strength of both types of inhibitory connections leads the network to the well-known winner-take-all behavior. If, however, the lateral inhibition is weaker than the self-inhibition, a certain number of neurons are activated in the steady states or the number of winners is in general more than one (the winners-share-all behavior). On the other hand, if the self-inhibition is weaker than the lateral one, only one neuron is activated, but the winner is not necessarily the neuron receiving the largest input. It is suggested that our simple network model provides a mathematical basis for understanding neural selection mechanisms.
引用
收藏
页码:77 / 97
页数:21
相关论文
共 27 条
[1]   PARALLEL ORGANIZATION OF FUNCTIONALLY SEGREGATED CIRCUITS LINKING BASAL GANGLIA AND CORTEX [J].
ALEXANDER, GE ;
DELONG, MR ;
STRICK, PL .
ANNUAL REVIEW OF NEUROSCIENCE, 1986, 9 :357-381
[2]   ABSOLUTE STABILITY OF GLOBAL PATTERN-FORMATION AND PARALLEL MEMORY STORAGE BY COMPETITIVE NEURAL NETWORKS [J].
COHEN, MA ;
GROSSBERG, S .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :815-826
[3]   A CORTICAL MODEL OF WINNER-TAKE-ALL COMPETITION VIA LATERAL INHIBITION [J].
COULTRIP, R ;
GRANGER, R ;
LYNCH, G .
NEURAL NETWORKS, 1992, 5 (01) :47-54
[4]  
Cowan J., 1968, NEURAL NETWORKS, P181
[5]  
COWAN JD, 1970, LECTURES MATH LIFE S, V2, P1
[6]   COMPLEX DYNAMICS IN WINNER-TAKE-ALL NEURAL NETS WITH SLOW INHIBITION [J].
ERMENTROUT, B .
NEURAL NETWORKS, 1992, 5 (03) :415-431
[7]   COGNITIVE NEUROPHYSIOLOGY OF THE MOTOR CORTEX [J].
GEORGOPOULOS, AP ;
TAIRA, M ;
LUKASHIN, A .
SCIENCE, 1993, 260 (5104) :47-52
[8]   THE INFLUENCE OF CONTEXTUAL STIMULI ON THE ORIENTATION SELECTIVITY OF CELLS IN PRIMARY VISUAL-CORTEX OF THE CAT [J].
GILBERT, CD ;
WIESEL, TN .
VISION RESEARCH, 1990, 30 (11) :1689-1701
[9]  
GROSSBERG S, 1973, STUD APPL MATH, V52, P213
[10]   SOME DEVELOPMENTAL AND ATTENTIONAL BIASES IN CONTRAST ENHANCEMENT AND SHORT-TERM MEMORY OF RECURRENT NEURAL NETWORKS [J].
GROSSBERG, S ;
LEVINE, D .
JOURNAL OF THEORETICAL BIOLOGY, 1975, 53 (02) :341-380