Working-memory capacity protects model-based learning from stress

被引:326
|
作者
Otto, A. Ross [1 ]
Raio, Candace M. [2 ]
Chiang, Alice [2 ]
Phelps, Elizabeth A. [1 ,2 ,3 ]
Daw, Nathaniel D. [1 ,2 ]
机构
[1] NYU, Ctr Neural Sci, New York, NY 10003 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
基金
美国国家卫生研究院;
关键词
DECISION-MAKING; DOPAMINE RELEASE; COLD PRESSOR; REINFORCEMENT; SYSTEMS; RISK; PREDICTION; STRATEGIES; ADDICTION; FRAMEWORK;
D O I
10.1073/pnas.1312011110
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive-dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response-believed to have detrimental effects on prefrontal cortex function-should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.
引用
收藏
页码:20941 / 20946
页数:6
相关论文
共 50 条
  • [1] The generalizability of working-memory capacity in the sport domain
    Buszard, Tim
    Masters, Rich S. W.
    Farrow, Damian
    CURRENT OPINION IN PSYCHOLOGY, 2017, 16 : 54 - 57
  • [2] Model-based learning protects against forming habits
    Gillan, Claire M.
    Otto, A. Ross
    Phelps, Elizabeth A.
    Daw, Nathaniel D.
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2015, 15 (03) : 523 - 536
  • [3] Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning
    Schad, Daniel J.
    Juenger, Elisabeth
    Sebold, Miriam
    Garbusow, Maria
    Bernhardt, Nadine
    Javadi, Amir-Homayoun
    Zimmermann, Ulrich S.
    Smolka, Michael N.
    Heinz, Andreas
    Rapp, Michael A.
    Huys, Quentin J. M.
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [4] The modulation of acute stress on model-free and model-based reinforcement learning in gambling disorder
    Wyckmans, Florent
    Banerjee, Nilosmita
    Saeremans, Melanie
    Otto, Ross
    Kornreich, Charles
    Vanderijst, Laetitia
    Gruson, Damien
    Carbone, Vincenzo
    Bechara, Antoine
    Buchanan, Tony
    Noel, Xavier
    JOURNAL OF BEHAVIORAL ADDICTIONS, 2022, 11 (03) : 831 - 844
  • [5] Prosocial learning: Model-based or model-free?
    Navidi, Parisa
    Saeedpour, Sepehr
    Ershadmanesh, Sara
    Hossein, Mostafa Miandari
    Bahrami, Bahador
    PLOS ONE, 2023, 18 (06):
  • [6] Impact of provoked stress on model-free and model-based reinforcement learning in individuals with alcohol use disorder
    Wyckmans, Florent
    Chatard, Armand
    Kornreich, Charles
    Gruson, Damien
    Jaafari, Nemat
    Noel, Xavier
    ADDICTIVE BEHAVIORS REPORTS, 2024, 20
  • [7] The ubiquity of model-based reinforcement learning
    Doll, Bradley B.
    Simon, Dylan A.
    Daw, Nathaniel D.
    CURRENT OPINION IN NEUROBIOLOGY, 2012, 22 (06) : 1075 - 1081
  • [8] Model-based Reinforcement Learning: A Survey
    Moerland, Thomas M.
    Broekens, Joost
    Plaat, Aske
    Jonker, Catholijn M.
    FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2023, 16 (01): : 1 - 118
  • [9] Working Memory Guides Action Valuation in Model-based Decision-making Strategy
    Zuo, Zhaoyu
    Yang, Li-Zhuang
    Wang, Hongzhi
    Li, Hai
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2025, 37 (01) : 86 - 96
  • [10] Hippocampal Contributions to Model-Based Planning and Spatial Memory
    Vikbladh, Oliver M.
    Meager, Michael R.
    King, John
    Blackmon, Karen
    Devinsky, Orrin
    Shohamy, Daphna
    Burgess, Neil
    Daw, Nathaniel D.
    NEURON, 2019, 102 (03) : 683 - +