Modulation of value-based decision making behavior by subregions of the rat prefrontal cortex

被引:50
作者
Verharen, Jeroen P. H. [1 ,2 ,3 ]
den Ouden, Hanneke E. M. [4 ]
Adan, Roger A. H. [1 ]
Vanderschuren, Louk J. M. J. [2 ]
机构
[1] Univ Med Ctr Utrecht, Brain Ctr Rudolf Magnus, Dept Translat Neurosci, NL-3584 CG Utrecht, Netherlands
[2] Univ Utrecht, Dept Anim Sci & Soc, Div Behav Neurosci, Fac Vet Med, NL-3584 CM Utrecht, Netherlands
[3] Univ Calif Berkeley, Dept Mol & Cell Biol, Helen Wills Neurosci Inst, 229 Stanley Hall, Berkeley, CA 94720 USA
[4] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, NL-6525 HR Nijmegen, Netherlands
关键词
Value; Prefrontal cortex; Decision-making; Reinforcement learning; Behavioral modeling; Rats; Reward; Punishment; ORBITOFRONTAL CORTEX; FUNCTIONAL-HETEROGENEITY; REWARD; PREDICTION; AMYGDALA; HABITS; BRAIN; MODEL; STAY; TASK;
D O I
10.1007/s00213-020-05454-7
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Rationale During value-based decision-making, organisms make choices on the basis of reward expectations, which have been formed during prior action-outcome learning. Although it is known that neuronal manipulations of different subregions of the rat prefrontal cortex (PFC) have qualitatively different effects on behavioral tasks involving value-based decision-making, it is unclear how these regions contribute to the underlying component processes. Objectives Assessing how different regions of the rodent PFC contribute to component processes of value-based decision-making behavior, including reward (or positive feedback) learning, punishment (or negative feedback) learning, response persistence, and exploration versus exploitation. Methods We performed behavioral modeling of data of rats in a probabilistic reversal learning task after pharmacological inactivation of five PFC subregions, to assess how inactivation of these different regions affected the structure of responding of animals in the task. Results Our results show reductions in reward and punishment learning after PFC subregion inactivation. The prelimbic, infralimbic, lateral orbital, and medial orbital PFC particularly contributed to punishment learning, and the prelimbic and lateral orbital PFC to reward learning. In addition, response persistence depended on the infralimbic and medial orbital PFC. As a result, pharmacological inactivation of the infralimbic and lateral orbitofrontal cortex reduced the number of reversals achieved, whereas inactivation of the prelimbic and medial orbitofrontal cortex decreased the number of rewards obtained. Finally, using simulated data, we explain discrepancies with a previous study and demonstrate complex, interacting relationships between conventional measures of probabilistic reversal learning performance, such as win-stay/lose-switch behavior, and component processes of value-based decision-making. Conclusions Together, our data suggest that distinct components of value-based learning and decision-making are generated in medial and orbital PFC regions, displaying functional specialization and overlap, with a prominent role of large parts of the PFC in negative feedback processing.
引用
收藏
页码:1267 / 1280
页数:14
相关论文
共 42 条
[1]   Serotonin Modulates Sensitivity to Reward and Negative Feedback in a Probabilistic Reversal Learning Task in Rats [J].
Bari, Andrea ;
Theobald, David E. ;
Caprioli, Daniele ;
Mar, Adam C. ;
Aidoo-Micah, Alex ;
Dalley, Jeffrey W. ;
Robbins, Trevor W. .
NEUROPSYCHOPHARMACOLOGY, 2010, 35 (06) :1290-1301
[2]   Decision-making and impulse control after frontal lobe injuries [J].
Bechara, A ;
Van der Linden, M .
CURRENT OPINION IN NEUROLOGY, 2005, 18 (06) :734-739
[3]  
Birrell JM, 2000, J NEUROSCI, V20, P4320
[4]   Prelimbic and Infralimbic Neurons Signal Distinct Aspects of Appetitive Instrumental Behavior [J].
Burgos-Robles, Anthony ;
Bravo-Rivera, Hector ;
Quirk, Gregory J. .
PLOS ONE, 2013, 8 (02)
[5]  
Chudasama Y, 2003, J NEUROSCI, V23, P8771
[6]   Making decisions through a distributed consensus [J].
Cisek, Paul .
CURRENT OPINION IN NEUROBIOLOGY, 2012, 22 (06) :927-936
[7]   Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration [J].
Cohen, Jonathan D. ;
McClure, Samuel M. ;
Yu, Angela J. .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2007, 362 (1481) :933-942
[8]   The role of prelimbic cortex in instrumental conditioning [J].
Corbit, LH ;
Balleine, BW .
BEHAVIOURAL BRAIN RESEARCH, 2003, 146 (1-2) :145-157
[9]   Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates [J].
Dalley, JW ;
Cardinal, RN ;
Robbins, TW .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2004, 28 (07) :771-784
[10]   Multifaceted Contributions by Different Regions of the Orbitofrontal and Medial Prefrontal Cortex to Probabilistic Reversal Learning [J].
Dalton, Gemma L. ;
Wang, Nena Y. ;
Phillips, Anthony G. ;
Floresco, Stan B. .
JOURNAL OF NEUROSCIENCE, 2016, 36 (06) :1996-2006