Working-memory capacity protects model-based learning from stress

被引:340
作者
Otto, A. Ross [1 ]
Raio, Candace M. [2 ]
Chiang, Alice [2 ]
Phelps, Elizabeth A. [1 ,2 ,3 ]
Daw, Nathaniel D. [1 ,2 ]
机构
[1] NYU, Ctr Neural Sci, New York, NY 10003 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
基金
美国国家卫生研究院;
关键词
DECISION-MAKING; DOPAMINE RELEASE; COLD PRESSOR; REINFORCEMENT; SYSTEMS; RISK; PREDICTION; STRATEGIES; ADDICTION; FRAMEWORK;
D O I
10.1073/pnas.1312011110
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response-believed to have detrimental effects on prefrontal cortex function-should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.
引用
收藏
页码:20941 / 20946
页数:6
相关论文
共 47 条
[1]   DIFFERENTIAL EFFECT OF STRESS ON INVIVO DOPAMINE RELEASE IN STRIATUM, NUCLEUS ACCUMBENS, AND MEDIAL FRONTAL-CORTEX [J].
ABERCROMBIE, ED ;
KEEFE, KA ;
DIFRISCHIA, DS ;
ZIGMOND, MJ .
JOURNAL OF NEUROCHEMISTRY, 1989, 52 (05) :1655-1658
[2]   Restraint increases dopaminergic burst firing in awake rats [J].
Anstrom, KK ;
Woodward, DJ .
NEUROPSYCHOPHARMACOLOGY, 2005, 30 (10) :1832-1840
[3]   Stress signalling pathways that impair prefrontal cortex structure and function [J].
Arnsten, Amy F. T. .
NATURE REVIEWS NEUROSCIENCE, 2009, 10 (06) :410-422
[4]   Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action [J].
Balleine, Bernard W. ;
O'Doherty, John P. .
NEUROPSYCHOPHARMACOLOGY, 2010, 35 (01) :48-69
[5]   Are executive function and impulsivity antipodes? A conceptual reconstruction with special reference to addiction [J].
Bickel, Warren K. ;
Jarmolowicz, David P. ;
Mueller, E. Terry ;
Gatchalian, Kirstin M. ;
McClure, Samuel M. .
PSYCHOPHARMACOLOGY, 2012, 221 (03) :361-387
[6]   Glucocorticoid receptors in the prefrontal cortex regulate stress-evoked dopamine efflux and aspects of executive function [J].
Butts, Kelly A. ;
Weinberg, Joanne ;
Young, Allan H. ;
Phillips, Anthony G. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (45) :18459-18464
[7]   Working memory capacity and its relation to general intelligence [J].
Conway, ARA ;
Kane, MJ ;
Engle, RW .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (12) :547-552
[8]   Inverted-U-Shaped Dopamine Actions on Human Working Memory and Cognitive Control [J].
Cools, Roshan ;
D'Esposito, Mark .
BIOLOGICAL PSYCHIATRY, 2011, 69 (12) :E113-E125
[9]   Model-Based Influences on Humans' Choices and Striatal Prediction Errors [J].
Daw, Nathaniel D. ;
Gershman, Samuel J. ;
Seymour, Ben ;
Dayan, Peter ;
Dolan, Raymond J. .
NEURON, 2011, 69 (06) :1204-1215
[10]   Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control [J].
Daw, ND ;
Niv, Y ;
Dayan, P .
NATURE NEUROSCIENCE, 2005, 8 (12) :1704-1711