FORMING SPARSE REPRESENTATIONS BY LOCAL ANTI-HEBBIAN LEARNING

被引：343

作者：

FOLDIAK, P

机构：

[1] Physiological Laboratory, University of Cambridge, Cambridge, CB2 3EG, Downing Street

来源：

BIOLOGICAL CYBERNETICS | 1990年 / 64卷 / 02期

关键词：

D O I：

10.1007/BF02331346

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

How does the brain form a useful representation of its environment? It is shown here that a layer of simple Hebbian units connected by modifiable anti-Hebbian feed-back connections can learn to code a set of patterns in such a way that statistical dependency between the elements of the representation is reduced, while information is preserved. The resulting code is sparse, which is favourable if it is to be used as input to a subsequent supervised associative layer. The operation of the network is demonstrated on two simple problems. © 1990 Springer-Verlag.

引用

页码：165 / 170

页数：6

共 19 条

[11] HEBB DO, 1949, ORG BEHAVIOR
[12] HOPFILED JJ, 1982, P NATL ACAD SCI USA, V79, P254
[13] Kohonen T., 1984, SELF ORG ASS MEMORY
[14] PALM G, 1980, BIOL CYBERN, V36, P19, DOI 10.1007/BF00337019
[15] RUBNER J, 1990, BIOL CYBERN, V62, P13
[16] von der Malsburg C, 1973, Kybernetik, V14, P85
[17] INFORMATION-THEORETICAL ASPECTS OF INDUCTIVE AND DEDUCTIVE INFERENCE
WATANABE, S
[J]. IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 1960, 4 (02) : 208 - 231
[18] Watanabe S., 1985, PATTERN RECOGN
[19] NON-HOLOGRAPHIC ASSOCIATIVE MEMORY
WILLSHAW, DJ
BUNEMAN, OP
LONGUETH.HC
[J]. NATURE, 1969, 222 (5197) : 960 - &

← 1 2 →