FORMING SPARSE REPRESENTATIONS BY LOCAL ANTI-HEBBIAN LEARNING

被引:347
作者
FOLDIAK, P
机构
[1] Physiological Laboratory, University of Cambridge, Cambridge, CB2 3EG, Downing Street
关键词
D O I
10.1007/BF02331346
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
How does the brain form a useful representation of its environment? It is shown here that a layer of simple Hebbian units connected by modifiable anti-Hebbian feed-back connections can learn to code a set of patterns in such a way that statistical dependency between the elements of the representation is reduced, while information is preserved. The resulting code is sparse, which is favourable if it is to be used as input to a subsequent supervised associative layer. The operation of the network is demonstrated on two simple problems. © 1990 Springer-Verlag.
引用
收藏
页码:165 / 170
页数:6
相关论文
共 19 条
[1]  
[Anonymous], 1987, LEARNING INTERNAL RE
[2]  
BARLOW H, 1989, COMP NEUR S, P54
[3]  
Barlow H, 1985, MODELS VISUAL CORTEX, P37
[4]  
Barlow H., 1961, SENS COMMUN, P217, DOI DOI 10.7551/MITPRESS/9780262518420.003.0013
[5]   Finding Minimum Entropy Codes [J].
Barlow, H. B. ;
Kaushal, T. P. ;
Mitchison, G. J. .
NEURAL COMPUTATION, 1989, 1 (03) :412-423
[6]   Unsupervised Learning [J].
Barlow, H. B. .
NEURAL COMPUTATION, 1989, 1 (03) :295-311
[7]  
Barlow H B, 1972, Perception, V1, P371, DOI 10.1068/p010371
[8]  
FOLDIAK P, 1989, JUN P IJCNN INT JOIN, V1, P401
[9]   ADAPTIVE PATTERN-CLASSIFICATION AND UNIVERSAL RECODING .1. PARALLEL DEVELOPMENT AND CODING OF NEURAL FEATURE DETECTORS [J].
GROSSBERG, S .
BIOLOGICAL CYBERNETICS, 1976, 23 (03) :121-134
[10]  
Harris C. S., 1980, VISUAL CODING ADAPTA