Neural representation of probabilistic information

被引:30
作者
Barber, MJ
Clark, JW
Anderson, CH
机构
[1] Univ Cologne, Inst Theoret Phys, D-50937 Cologne, Germany
[2] Washington Univ, Dept Phys, St Louis, MO 63130 USA
[3] Washington Univ, Sch Med, Dept Anat & Neurobiol, St Louis, MO 63110 USA
关键词
D O I
10.1162/08997660360675062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has been proposed that populations of neurons process information in terms of probability density functions (PDFs) of analog variables. Such analog variables range, for example, from target luminance and depth on the sensory interface to eye position and joint angles on the motor output side. The requirement that analog variables must be processed leads inevitably to a probabilistic description, while the limited precision and lifetime of the neuronal processing units lead naturally to a population representation of information. We show how a time-dependent probability density rho (x; t) over variable x, residing in a specified function space of dimension D, may be decoded from the neuronal activities in a population as a linear combination of certain decoding functions phi(i)(x), with coefficients given by the N firing rates a(i)(t) (generally with D << N). We show how the neuronal encoding process may be described by projecting a set of complementary encoding functions (phi) over cap (i)(x) on the probability density rho (x; t), and passing the result through a rectifying nonlinear activation function. We show how both encoders (phi) over cap (i)(x) and decoders phi(i)(x) may be determined by minimizing cost functions that quantify the inaccuracy of the representation. Expressing a given computation in terms of manipulation and transformation of probabilities, we show how this representation leads to a neural circuit that can carry out the required computation within a consistent Bayesian framework, with the synaptic weights being explicitly generated in terms of encoders, decoders, conditional probabilities, and priors.
引用
收藏
页码:1843 / 1864
页数:22
相关论文
共 32 条
[1]  
ABBOTT L, 1999, NEURAL COMPUT, V11
[2]  
ANDERSON C, 1996, CONDENSED MATTER THE, V11, P365
[3]   SHIFTER CIRCUITS - A COMPUTATIONAL STRATEGY FOR DYNAMIC ASPECTS OF VISUAL PROCESSING [J].
ANDERSON, CH ;
VANESSEN, DC .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1987, 84 (17) :6297-6301
[4]   BASIC ELEMENTS OF BIOLOGICAL COMPUTATIONAL SYSTEMS [J].
ANDERSON, CH .
INTERNATIONAL JOURNAL OF MODERN PHYSICS C-PHYSICS AND COMPUTERS, 1994, 5 (02) :313-315
[5]  
ANDERSON CH, 1987, P IEEE 1 INT C NEUR, V3, P105
[6]  
BARBER M, 1999, THESIS WASHINGTON U
[7]   RELIABILITY AND INFORMATION-TRANSMISSION IN SPIKING NEURONS [J].
BIALEK, W ;
RIEKE, F .
TRENDS IN NEUROSCIENCES, 1992, 15 (11) :428-434
[8]   READING A NEURAL CODE [J].
BIALEK, W ;
RIEKE, F ;
VANSTEVENINCK, RRD ;
WARLAND, D .
SCIENCE, 1991, 252 (5014) :1854-1857
[9]  
Cash S, 1998, J NEUROSCI, V18, P10
[10]   Varieties of Helmholtz machine [J].
Dayan, P ;
Hinton, GE .
NEURAL NETWORKS, 1996, 9 (08) :1385-1403