Working-memory capacity protects model-based learning from stress

被引:326
|
作者
Otto, A. Ross [1 ]
Raio, Candace M. [2 ]
Chiang, Alice [2 ]
Phelps, Elizabeth A. [1 ,2 ,3 ]
Daw, Nathaniel D. [1 ,2 ]
机构
[1] NYU, Ctr Neural Sci, New York, NY 10003 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
基金
美国国家卫生研究院;
关键词
DECISION-MAKING; DOPAMINE RELEASE; COLD PRESSOR; REINFORCEMENT; SYSTEMS; RISK; PREDICTION; STRATEGIES; ADDICTION; FRAMEWORK;
D O I
10.1073/pnas.1312011110
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response-believed to have detrimental effects on prefrontal cortex function-should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.
引用
收藏
页码:20941 / 20946
页数:6
相关论文
共 50 条
  • [41] Validating model-based data interpretation methods for quantification of reserve capacity
    Pai, Sai G. S.
    Smith, Ian F. C.
    ADVANCED ENGINEERING INFORMATICS, 2021, 47
  • [42] Ventral Striatum and Orbitofrontal Cortex Are Both Required for Model-Based, But Not Model-Free, Reinforcement Learning
    McDannald, Michael A.
    Lucantonio, Federica
    Burke, Kathryn A.
    Niv, Yael
    Schoenbaum, Geoffrey
    JOURNAL OF NEUROSCIENCE, 2011, 31 (07) : 2700 - 2705
  • [43] Comparison of traditional model-based statistical methods with machine learning for the prediction of suicide behaviour
    Nicolas Grendas, Leandro
    Chiapella, Luciana
    Emanuel Rodante, Demian
    Manuel Daray, Federico
    JOURNAL OF PSYCHIATRIC RESEARCH, 2022, 145 : 85 - 91
  • [44] Model-based learning retrospectively updates model-free values
    Doody, Max
    Van Swieten, Maaike M. H.
    Manohar, Sanjay G.
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [45] Cooperative Model-Based Reinforcement Learning for Approximate Optimal Tracking
    Greene, Max L.
    Bell, Zachary, I
    Nivison, Scott A.
    How, Jonathan P.
    Dixon, Warren E.
    2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 1973 - 1978
  • [46] Model-Based Reinforcement Learning via Stochastic Hybrid Models
    Abdulsamad, Hany
    Peters, Jan
    IEEE OPEN JOURNAL OF CONTROL SYSTEMS, 2023, 2 : 155 - 170
  • [47] Model-based hierarchical reinforcement learning and human action control
    Botvinick, Matthew
    Weinstein, Ari
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2014, 369 (1655)
  • [48] Model-based and Model-free Learning: A Trans-diagnostic Approach
    Voon, Valerie
    BIOLOGICAL PSYCHIATRY, 2015, 77 (09) : 39S - 39S
  • [49] From whom do animals learn? A meta-analysis on model-based social learning
    Andrés Camacho-Alpízar
    Lauren M. Guillette
    Psychonomic Bulletin & Review, 2023, 30 : 863 - 881
  • [50] Adaptive optics control using model-based reinforcement learning
    Nousiainen, Jalo
    Rajani, Chang
    Kasper, Markus
    Helin, Tapio
    OPTICS EXPRESS, 2021, 29 (10) : 15327 - 15344