Prefrontal Goal Codes Emerge as Latent States in Probabilistic Value Learning

被引:34
作者
Stoianov, Ivilin [1 ,2 ,3 ]
Genovesio, Aldo [4 ]
Pezzulo, Giovanni [1 ]
机构
[1] CNR, I-00185 Rome, Italy
[2] CNRS, F-75700 Paris, France
[3] Aix Marseille Univ, Marseille, France
[4] Univ Roma La Sapienza, Rome, Italy
关键词
COGNITIVE CONTROL; DIRECTED BEHAVIOR; ACTIVE INFERENCE; DECISION-MAKING; BASAL GANGLIA; CORTEX; REPRESENTATION; INFORMATION; MODELS; NUMBER;
D O I
10.1162/jocn_a_00886
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The prefrontal cortex (PFC) supports goal-directed actions and exerts cognitive control over behavior, but the underlying coding and mechanism are heavily debated. We present evidence for the role of goal coding in PFC from two converging perspectives: computational modeling and neuronal-level analysis of monkey data. We show that neural representations of prospective goals emerge by combining a categorization process that extracts relevant behavioral abstractions from the input data and a reward-driven process that selects candidate categories depending on their adaptive value; both forms of learning have a plausible neural implementation in PFC. Our analyses demonstrate a fundamental principle: goal coding represents an efficient solution to cognitive control problems, analogous to efficient coding principles in other (e.g., visual) brain areas. The novel analytical-computational approach is of general interest because it applies to a variety of neurophysiological studies.
引用
收藏
页码:140 / 157
页数:18
相关论文
共 59 条
  • [41] The principles of goal-directed decision-making: from neural mechanisms to computation and robotics Introduction
    Pezzulo, Giovanni
    Verschure, Paul F. M. J.
    Balkenius, Christian
    Pennartz, Cyriel M. A.
    [J]. PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2014, 369 (1655)
  • [42] The Mixed Instrumental Controller: using Value of Information to combine habitual choice and mental simulation
    Pezzulo, Giovanni
    Rigoli, Francesco
    Chersi, Fabian
    [J]. FRONTIERS IN PSYCHOLOGY, 2013, 4
  • [43] Thinking as the control of imagination: a conceptual framework for goal-directed systems
    Pezzulo, Giovanni
    Castelfranchi, Cristiano
    [J]. PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2009, 73 (04): : 559 - 577
  • [44] Exact and approximate arithmetic in an Amazonian indigene group
    Pica, P
    Lemer, C
    Izard, W
    Dehaene, S
    [J]. SCIENCE, 2004, 306 (5695) : 499 - 503
  • [45] Probabilistic brains: knowns and unknowns
    Pouget, Alexandre
    Beck, Jeffrey M.
    Ma, Wei Ji
    Latham, Peter E.
    [J]. NATURE NEUROSCIENCE, 2013, 16 (09) : 1170 - 1178
  • [46] Compositionality of Rule Representations in Human Prefrontal Cortex
    Reverberi, Carlo
    Goergen, Kai
    Haynes, John-Dylan
    [J]. CEREBRAL CORTEX, 2012, 22 (06) : 1237 - 1246
  • [47] The importance of mixed selectivity in complex cognitive tasks
    Rigotti, Mattia
    Barak, Omri
    Warden, Melissa R.
    Wang, Xiao-Jing
    Daw, Nathaniel D.
    Miller, Earl K.
    Fusi, Stefano
    [J]. NATURE, 2013, 497 (7451) : 585 - 590
  • [48] Rational Approximations to Rational Models: Alternative Algorithms for Category Learning
    Sanborn, Adam N.
    Griffiths, Thomas L.
    Navarro, Daniel J.
    [J]. PSYCHOLOGICAL REVIEW, 2010, 117 (04) : 1144 - 1167
  • [49] Category Learning in the Brain
    Seger, Carol A.
    Miller, Earl K.
    [J]. ANNUAL REVIEW OF NEUROSCIENCE, VOL 33, 2010, 33 : 203 - 219
  • [50] Categorization of behavioural sequences in the prefrontal cortex
    Shima, Keisetsu
    Isoda, Masaki
    Mushiake, Hajime
    Tanji, Jun
    [J]. NATURE, 2007, 445 (7125) : 315 - 318