Maximum Entropy Approaches to Living Neural Networks

被引:42
作者
Yeh, Fang-Chin [1 ]
Tang, Aonan [1 ]
Hobbs, Jon P. [2 ]
Hottowy, Pawel [3 ]
Dabrowski, Wladyslaw [3 ]
Sher, Alexander [4 ]
Litke, Alan [4 ]
Beggs, John M. [1 ,2 ]
机构
[1] Indiana Univ, Dept Phys, Bloomington, IN 47405 USA
[2] Indiana Univ, Program Neurosci, Bloomington, IN 47405 USA
[3] AGH Univ Sci & Technol, Fac Phys & Appl Comp Sci, PL-30059 Krakow, Poland
[4] Univ Calif Santa Cruz, Inst Particle Phys, Santa Cruz, CA 95064 USA
基金
美国国家科学基金会;
关键词
maximum entropy; neural network; multielectrode array; Ising model; INFORMATION-THEORY; DYNAMICS; PATTERNS; SYSTEMS; HISTORY; STATES; BRAIN;
D O I
10.3390/e12010089
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Understanding how ensembles of neurons collectively interact will be a key step in developing a mechanistic theory of cognitive processes. Recent progress in multineuron recording and analysis techniques has generated tremendous excitement over the physiology of living neural networks. One of the key developments driving this interest is a new class of models based on the principle of maximum entropy. Maximum entropy models have been reported to account for spatial correlation structure in ensembles of neurons recorded from several different types of data. Importantly, these models require only information about the firing rates of individual neurons and their pairwise correlations. If this approach is generally applicable, it would drastically simplify the problem of understanding how neural networks behave. Given the interest in this method, several groups now have worked to extend maximum entropy models to account for temporal correlations. Here, we review how maximum entropy models have been applied to neuronal ensemble data to account for spatial and temporal correlations. We also discuss criticisms of the maximum entropy approach that argue that it is not generally applicable to larger ensembles of neurons. We conclude that future maximum entropy models will need to address three issues: temporal correlations, higher-order correlations, and larger ensemble sizes. Finally, we provide a brief list of topics for future research.
引用
收藏
页码:89 / 106
页数:18
相关论文
共 46 条
  • [1] Information geometry on hierarchy of probability distributions
    Amari, S
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2001, 47 (05) : 1701 - 1711
  • [2] BRODERICK T, 2008, FASTER SOLUTIONS INV
  • [3] HISTORY OF LENZ-ISING MODEL
    BRUSH, SG
    [J]. REVIEWS OF MODERN PHYSICS, 1967, 39 (04) : 883 - +
  • [4] Cohen Isaac., 1985, BIRTH NEW PHYS
  • [5] Attractor dynamics of network UP states in the neocortex
    Cossart, R
    Aronov, D
    Yuste, R
    [J]. NATURE, 2003, 423 (6937) : 283 - 288
  • [6] Cover T. M., 1999, Elements of information theory
  • [7] GENERALIZED ITERATIVE SCALING FOR LOG-LINEAR MODELS
    DARROCH, JN
    RATCLIFF, D
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1972, 43 (05): : 1470 - &
  • [8] Maximum entropy production and the fluctuation theorem
    Dewar, RC
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 2005, 38 (21): : L371 - L381
  • [9] Haykin S., 1999, Neural Networks: A Comprehensive Foundation, DOI DOI 10.1017/S0269888998214044
  • [10] NEURAL NETWORKS AND PHYSICAL SYSTEMS WITH EMERGENT COLLECTIVE COMPUTATIONAL ABILITIES
    HOPFIELD, JJ
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1982, 79 (08): : 2554 - 2558