The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection

被引:67
作者
Akam, Thomas [1 ,2 ]
Rodrigues-Vaz, Ines [1 ,3 ]
Marcelo, Ivo [1 ,4 ]
Zhang, Xiangyu [5 ,6 ]
Pereira, Michael [1 ]
Oliveira, Rodrigo Freire [1 ]
Dayan, Peter [7 ,8 ,9 ]
Costa, Rui M. [1 ,3 ]
机构
[1] Champalimaud Ctr Unknown, Champalimaud Neurosci Program, Lisbon, Portugal
[2] Univ Oxford, Dept Expt Psychol, Oxford, England
[3] Columbia Univ, Zuckerman Mind Brain Behav Inst, Dept Neurosci & Neurol, New York, NY USA
[4] Erasmus MC Univ Med Ctr, Dept Psychiat, NL-3015 GD Rotterdam, Netherlands
[5] MIT, RIKEN MIT Ctr Neural Circuit Genet, Picower Inst Learning & Memory, Dept Biol, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[6] MIT, Dept Brain & Cognit Sci, E25-618, Cambridge, MA 02139 USA
[7] UCL, Gatsby Computat Neurosci Unit, London, England
[8] Max Planck Inst Biol Cybernet, Tubingen, Germany
[9] Univ Tubingen, Tubingen, Germany
基金
英国惠康基金; 欧洲研究理事会; 美国国家卫生研究院;
关键词
PREFRONTAL CORTEX; DORSOMEDIAL STRIATUM; FRONTAL-CORTEX; DISTINCT ROLES; DORSAL; CHOICES; MOUSE; COMPUTATIONS; UNCERTAINTY; SYSTEMS;
D O I
10.1016/j.neuron.2020.10.013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions.
引用
收藏
页码:149 / 163.e7
页数:23
相关论文
共 68 条
[1]   INSTRUMENTAL RESPONDING FOLLOWING REINFORCER DEVALUATION [J].
ADAMS, CD ;
DICKINSON, A .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1981, 33 (MAY) :109-121
[2]   Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task [J].
Akam, Thomas ;
Costa, Rui ;
Dayan, Peter .
PLOS COMPUTATIONAL BIOLOGY, 2015, 11 (12)
[3]   Medial prefrontal cortex as an action-outcome predictor [J].
Alexander, William H. ;
Brown, Joshua W. .
NATURE NEUROSCIENCE, 2011, 14 (10) :1338-U163
[4]  
[Anonymous], 2019, BIORXIV, DOI DOI 10.1101/718106
[5]   Goal-directed instrumental action: contingency and incentive learning and their cortical substrates [J].
Balleine, BW ;
Dickinson, A .
NEUROPHARMACOLOGY, 1998, 37 (4-5) :407-419
[6]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[7]   Neuronal Encoding of Subjective Value in Dorsal and Ventral Anterior Cingulate Cortex [J].
Cai, Xinying ;
Padoa-Schioppa, Camillo .
JOURNAL OF NEUROSCIENCE, 2012, 32 (11) :3791-3808
[8]  
Castro-Rodrigues P., 2020, EXPLICIT KNOWLEDGE T
[9]   Noninvasive optical inhibition with a red-shifted microbial rhodopsin [J].
Chuong, Amy S. ;
Miri, Mitra L. ;
Busskamp, Volker ;
Matthews, Gillian A. C. ;
Acker, Leah C. ;
Sorensen, Andreas T. ;
Young, Andrew ;
Klapoetke, Nathan C. ;
Henninger, Mike A. ;
Kodandaramaiah, Suhasa B. ;
Ogawa, Masaaki ;
Ramanlal, Shreshtha B. ;
Bandler, Rachel C. ;
Allen, Brian D. ;
Forest, Craig R. ;
Chow, Brian Y. ;
Han, Xue ;
Lin, Yingxi ;
Tye, Kay M. ;
Roska, Botond ;
Cardin, Jessica A. ;
Boyden, Edward S. .
NATURE NEUROSCIENCE, 2014, 17 (08) :1123-1129
[10]   Model-Based Influences on Humans' Choices and Striatal Prediction Errors [J].
Daw, Nathaniel D. ;
Gershman, Samuel J. ;
Seymour, Ben ;
Dayan, Peter ;
Dolan, Raymond J. .
NEURON, 2011, 69 (06) :1204-1215