Working-memory capacity protects model-based learning from stress

被引:326
|
作者
Otto, A. Ross [1 ]
Raio, Candace M. [2 ]
Chiang, Alice [2 ]
Phelps, Elizabeth A. [1 ,2 ,3 ]
Daw, Nathaniel D. [1 ,2 ]
机构
[1] NYU, Ctr Neural Sci, New York, NY 10003 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
基金
美国国家卫生研究院;
关键词
DECISION-MAKING; DOPAMINE RELEASE; COLD PRESSOR; REINFORCEMENT; SYSTEMS; RISK; PREDICTION; STRATEGIES; ADDICTION; FRAMEWORK;
D O I
10.1073/pnas.1312011110
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response-believed to have detrimental effects on prefrontal cortex function-should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.
引用
收藏
页码:20941 / 20946
页数:6
相关论文
共 50 条
  • [31] Working memory capacity and retrieval from long-term memory: the role of controlled search
    Unsworth, Nash
    Brewer, Gene A.
    Spillers, Gregory J.
    MEMORY & COGNITION, 2013, 41 (02) : 242 - 254
  • [32] Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
    Glaescher, Jan P.
    O'Doherty, John P.
    WILEY INTERDISCIPLINARY REVIEWS-COGNITIVE SCIENCE, 2010, 1 (04) : 501 - 510
  • [33] Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task
    Viejo, Guillaume
    Girard, Benoit
    Procyk, Emmanuel
    Khamassi, Mehdi
    BEHAVIOURAL BRAIN RESEARCH, 2018, 355 : 76 - 89
  • [34] A queuing model-based approach for the analysis of transactional memory systems
    Yu, Xiao
    He, Zhengyu
    Hong, Bo
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2013, 25 (06) : 808 - 825
  • [35] Simulating the healthcare workforce impact and capacity for pancreatic cancer care in Victoria: a model-based analysis
    Gao, Lan
    Ugalde, Anna
    Livingston, Patricia M.
    White, Victoria
    Watts, Jennifer J.
    Jongebloed, Hannah
    Mccaffrey, Nikki
    Menzies, David
    Robinson, Suzanne
    BMC HEALTH SERVICES RESEARCH, 2024, 24 (01)
  • [36] Model-Based Simulation and Optimization of Cutting Operations in Sheet Metal Working
    Dhote, G. M.
    Kale, A. V.
    PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, 2013, VOL 2B, 2013,
  • [37] Model-Based Reinforcement Learning in Differential Graphical Games
    Kamalapurkar, Rushikesh
    Klotz, Justin R.
    Walters, Patrick
    Dixon, Warren E.
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2018, 5 (01): : 423 - 433
  • [38] Transcranial Direct Current Stimulation of Right Dorsolateral Prefrontal Cortex Does Not Affect Model-Based or Model-Free Reinforcement Learning in Humans
    Smittenaar, Peter
    Prichard, George
    FitzGerald, Thomas H. B.
    Diedrichsen, Joern
    Dolan, Raymond J.
    PLOS ONE, 2014, 9 (01):
  • [39] From Model-Based Optimization Algorithms to Deep Learning Models for Clustering Hyperspectral Images
    Huang, Shaoguang
    Zhang, Hongyan
    Zeng, Haijin
    Pizurica, Aleksandra
    REMOTE SENSING, 2023, 15 (11)
  • [40] Learning from a lot: Empirical Bayes for high-dimensional model-based prediction
    van de Wiel, Mark A.
    Te Beest, Dennis E.
    Muench, Magnus M.
    SCANDINAVIAN JOURNAL OF STATISTICS, 2019, 46 (01) : 2 - 25