Working-memory capacity protects model-based learning from stress

被引:326
|
作者
Otto, A. Ross [1 ]
Raio, Candace M. [2 ]
Chiang, Alice [2 ]
Phelps, Elizabeth A. [1 ,2 ,3 ]
Daw, Nathaniel D. [1 ,2 ]
机构
[1] NYU, Ctr Neural Sci, New York, NY 10003 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
基金
美国国家卫生研究院;
关键词
DECISION-MAKING; DOPAMINE RELEASE; COLD PRESSOR; REINFORCEMENT; SYSTEMS; RISK; PREDICTION; STRATEGIES; ADDICTION; FRAMEWORK;
D O I
10.1073/pnas.1312011110
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response-believed to have detrimental effects on prefrontal cortex function-should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.
引用
收藏
页码:20941 / 20946
页数:6
相关论文
共 50 条
  • [21] A regime-switching approach to model-based stress testing
    Tashman, Adam P.
    JOURNAL OF RISK MODEL VALIDATION, 2009, 3 (04): : 89 - 101
  • [22] Cognitive Control Predicts Use of Model-based Reinforcement Learning
    Otto, A. Ross
    Skatova, Anya
    Madlon-Kay, Seth
    Daw, Nathaniel D.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2015, 27 (02) : 319 - 333
  • [23] Advances in model-based reinforcement learning for Adaptive Optics control
    Nousiainen, Jalo
    Engler, Byron
    Kasper, Markus
    Helin, Tapio
    Heritier, Cedric T.
    Rajani, Chang
    ADAPTIVE OPTICS SYSTEMS VIII, 2022, 12185
  • [24] Stress reduces both model-based and model-free neural computations during flexible learning
    Cremer, Anna
    Kalbe, Felix
    Glaescher, Jan
    Schwabe, Lars
    NEUROIMAGE, 2021, 229
  • [25] Memory-related cognitive load effects in an interrupted learning task: A model-based explanation
    Wirzberger, Maria
    Borst, Jelmer P.
    Krems, Josef F.
    Rey, Guenter Daniel
    TRENDS IN NEUROSCIENCE AND EDUCATION, 2020, 20
  • [26] Working Memory Capacity Limits Motor Learning When Implementing Multiple Instructions
    Buszard, Tim
    Farrow, Damian
    Verswijveren, Simone J. J. M.
    Reid, Machar
    Williams, Jacqueline
    Polman, Remco
    Ling, Fiona Chun Man
    Masters, Rich S. W.
    FRONTIERS IN PSYCHOLOGY, 2017, 8
  • [27] Laboratory experiments of model-based reinforcement learning for adaptive optics control
    Nousiainen, Jalo
    Engler, Byron
    Kasper, Markus
    Rajani, Chang
    Helin, Tapio
    Heritier, Cedric T.
    Quanz, Sascha P.
    Glauser, Adrian M.
    JOURNAL OF ASTRONOMICAL TELESCOPES INSTRUMENTS AND SYSTEMS, 2024, 10 (01)
  • [28] Influence of affective distractors on working memory capacity in relation to symptoms of posttraumatic stress disorder
    Mirabolfathi, Vida
    Moradi, Ali Reza
    Jobson, Laura
    APPLIED COGNITIVE PSYCHOLOGY, 2019, 33 (05) : 904 - 910
  • [29] Effects of subclinical depression on prefrontal-striatal model-based and model-free learning
    Heo, Suyeon
    Sung, Yoondo
    Lee, Sang Wan
    PLOS COMPUTATIONAL BIOLOGY, 2021, 17 (05)
  • [30] Extraversion differentiates between model-based and model-free strategies in a reinforcement learning task
    Skatova, Anya
    Chan, Patricia A.
    Daw, Nathaniel D.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7