The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection

被引:63
作者
Akam, Thomas [1 ,2 ]
Rodrigues-Vaz, Ines [1 ,3 ]
Marcelo, Ivo [1 ,4 ]
Zhang, Xiangyu [5 ,6 ]
Pereira, Michael [1 ]
Oliveira, Rodrigo Freire [1 ]
Dayan, Peter [7 ,8 ,9 ]
Costa, Rui M. [1 ,3 ]
机构
[1] Champalimaud Ctr Unknown, Champalimaud Neurosci Program, Lisbon, Portugal
[2] Univ Oxford, Dept Expt Psychol, Oxford, England
[3] Columbia Univ, Zuckerman Mind Brain Behav Inst, Dept Neurosci & Neurol, New York, NY USA
[4] Erasmus MC Univ Med Ctr, Dept Psychiat, NL-3015 GD Rotterdam, Netherlands
[5] MIT, RIKEN MIT Ctr Neural Circuit Genet, Picower Inst Learning & Memory, Dept Biol, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[6] MIT, Dept Brain & Cognit Sci, E25-618, Cambridge, MA 02139 USA
[7] UCL, Gatsby Computat Neurosci Unit, London, England
[8] Max Planck Inst Biol Cybernet, Tubingen, Germany
[9] Univ Tubingen, Tubingen, Germany
基金
英国惠康基金; 美国国家卫生研究院; 欧洲研究理事会;
关键词
PREFRONTAL CORTEX; DORSOMEDIAL STRIATUM; FRONTAL-CORTEX; DISTINCT ROLES; DORSAL; CHOICES; MOUSE; COMPUTATIONS; UNCERTAINTY; SYSTEMS;
D O I
10.1016/j.neuron.2020.10.013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions.
引用
收藏
页码:149 / 163.e7
页数:23
相关论文
共 68 条
  • [1] INSTRUMENTAL RESPONDING FOLLOWING REINFORCER DEVALUATION
    ADAMS, CD
    DICKINSON, A
    [J]. QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1981, 33 (MAY): : 109 - 121
  • [2] Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task
    Akam, Thomas
    Costa, Rui
    Dayan, Peter
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2015, 11 (12)
  • [3] Medial prefrontal cortex as an action-outcome predictor
    Alexander, William H.
    Brown, Joshua W.
    [J]. NATURE NEUROSCIENCE, 2011, 14 (10) : 1338 - U163
  • [4] [Anonymous], 2019, BIORXIV, DOI DOI 10.1101/718106
  • [5] Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
    Balleine, BW
    Dickinson, A
    [J]. NEUROPHARMACOLOGY, 1998, 37 (4-5) : 407 - 419
  • [6] CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING
    BENJAMINI, Y
    HOCHBERG, Y
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) : 289 - 300
  • [7] Neuronal Encoding of Subjective Value in Dorsal and Ventral Anterior Cingulate Cortex
    Cai, Xinying
    Padoa-Schioppa, Camillo
    [J]. JOURNAL OF NEUROSCIENCE, 2012, 32 (11) : 3791 - 3808
  • [8] Castro-Rodrigues P., 2020, EXPLICIT KNOWLEDGE T
  • [9] Noninvasive optical inhibition with a red-shifted microbial rhodopsin
    Chuong, Amy S.
    Miri, Mitra L.
    Busskamp, Volker
    Matthews, Gillian A. C.
    Acker, Leah C.
    Sorensen, Andreas T.
    Young, Andrew
    Klapoetke, Nathan C.
    Henninger, Mike A.
    Kodandaramaiah, Suhasa B.
    Ogawa, Masaaki
    Ramanlal, Shreshtha B.
    Bandler, Rachel C.
    Allen, Brian D.
    Forest, Craig R.
    Chow, Brian Y.
    Han, Xue
    Lin, Yingxi
    Tye, Kay M.
    Roska, Botond
    Cardin, Jessica A.
    Boyden, Edward S.
    [J]. NATURE NEUROSCIENCE, 2014, 17 (08) : 1123 - 1129
  • [10] Model-Based Influences on Humans' Choices and Striatal Prediction Errors
    Daw, Nathaniel D.
    Gershman, Samuel J.
    Seymour, Ben
    Dayan, Peter
    Dolan, Raymond J.
    [J]. NEURON, 2011, 69 (06) : 1204 - 1215