Heterogeneity in strategy use during arbitration between experiential and observational learning

被引:0
作者
Charpentier, Caroline J. [1 ,2 ,3 ]
Wu, Qianying [1 ]
Min, Seokyoung [1 ]
Ding, Weilun [1 ]
Cockburn, Jeffrey [1 ]
O'Doherty, John P. [1 ]
机构
[1] CALTECH, Div Humanities & Social Sci, Pasadena, CA 91125 USA
[2] Univ Maryland, Dept Psychol, College Pk, MD 20742 USA
[3] Univ Maryland, Brain & Behav Inst, College Pk, MD 20742 USA
基金
英国惠康基金;
关键词
NEURAL MECHANISMS; REINFORCEMENT; ADULTS; COMPUTATIONS; IMITATION;
D O I
10.1038/s41467-024-48548-y
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
To navigate our complex social world, it is crucial to deploy multiple learning strategies, such as learning from directly experiencing action outcomes or from observing other people's behavior. Despite the prevalence of experiential and observational learning in humans and other social animals, it remains unclear how people favor one strategy over the other depending on the environment, and how individuals vary in their strategy use. Here, we describe an arbitration mechanism in which the prediction errors associated with each learning strategy influence their weight over behavior. We designed an online behavioral task to test our computational model, and found that while a substantial proportion of participants relied on the proposed arbitration mechanism, there was some meaningful heterogeneity in how people solved this task. Four other groups were identified: those who used a fixed mixture between the two strategies, those who relied on a single strategy and non-learners with irrelevant strategies. Furthermore, groups were found to differ on key behavioral signatures, and on transdiagnostic symptom dimensions, in particular autism traits and anxiety. Together, these results demonstrate how large heterogeneous datasets and computational methods can be leveraged to better characterize individual differences. People learn by observing others and from personal experience, but which strategy they favor varies. Here, the authors show that while some people dynamically arbitrate and switch to the strategy that is most reliable, others preferentially use one or a fixed mixture of strategies.
引用
收藏
页数:20
相关论文
共 77 条
  • [1] A neural and behavioral trade-off between value and uncertainty underlies exploratory decisions in normative anxiety
    Aberg, Kristoffer C.
    Toren, Ido
    Paz, Rony
    [J]. MOLECULAR PSYCHIATRY, 2022, 27 (03) : 1573 - 1587
  • [2] Altered learning under uncertainty in unmedicated mood and anxiety disorders
    Aylward, Jessica
    Valton, Vincent
    Ahn, Woo-Young
    Bond, Rebecca L.
    Dayan, Peter
    Roiser, Jonathan P.
    Robinson, Oliver J.
    [J]. NATURE HUMAN BEHAVIOUR, 2019, 3 (10) : 1116 - 1123
  • [3] VICARIOUS REINFORCEMENT AND IMITATIVE LEARNING
    BANDURA, A
    ROSS, SA
    ROSS, D
    [J]. JOURNAL OF ABNORMAL PSYCHOLOGY, 1963, 67 (06) : 601 - &
  • [4] Beck A. T., 1996, MANUAL BECK DEPRESSI
  • [5] Associative learning of social value
    Behrens, Timothy E. J.
    Hunt, Laurence T.
    Woolrich, Mark W.
    Rushworth, Matthew F. S.
    [J]. NATURE, 2008, 456 (7219) : 245 - U45
  • [6] Computational Models for the Combination of Advice and Individual Learning
    Biele, Guido
    Rieskamp, Joerg
    Gonzalez, Richard
    [J]. COGNITIVE SCIENCE, 2009, 33 (02) : 206 - 242
  • [7] The influence of depression symptoms on exploratory decision-making
    Blanco, Nathaniel J.
    Otto, A. Ross
    Maddox, W. Todd
    Beevers, Christopher G.
    Love, Bradley C.
    [J]. COGNITION, 2013, 129 (03) : 563 - 568
  • [8] The Behavioral and Neural Mechanisms Underlying the Tracking of Expertise
    Boorman, Erie D.
    O'Doherty, John P.
    Adolphs, Ralph
    Rangel, Antonio
    [J]. NEURON, 2013, 80 (06) : 1558 - 1571
  • [9] Anxious individuals have difficulty learning the causal statistics of aversive environments
    Browning, Michael
    Behrens, Timothy E.
    Jocham, Gerhard
    O'Reilly, Jill X.
    Bishop, Sonia J.
    [J]. NATURE NEUROSCIENCE, 2015, 18 (04) : 590 - +
  • [10] Neural mechanisms of observational learning
    Burke, Christopher J.
    Tobler, Philippe N.
    Baddeley, Michelle
    Schultz, Wolfram
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2010, 107 (32) : 14431 - 14436