Proselfs depend more on model-based than model-free learning in a non-social probabilistic state-transition task

被引:0
|
作者
Oguchi, Mineki [1 ]
Li, Yang [1 ,2 ]
Matsumoto, Yoshie [1 ,3 ]
Kiyonari, Toko [4 ]
Yamamoto, Kazuhiko [5 ]
Sugiura, Shigeki [5 ]
Sakagami, Masamichi [1 ]
机构
[1] Tamagawa Univ, Brain Sci Inst, 6 1 1 Tamagawagakuen, Machida, Tokyo, Japan
[2] Nagoya Univ, Grad Sch Informat, Nagoya, Japan
[3] Seinan Gakuin Univ, Fac Human Sci, Dept Psychol, Fukuoka, Japan
[4] Aoyama Gakuin Univ, Sch Social Informat, Sagamihara, Kanagawa, Japan
[5] Genesis Res Inst, Nagoya, Aichi, Japan
关键词
SOCIAL VALUE ORIENTATION; DECISION-MAKING; MECHANISMS; FOUNDATIONS; COOPERATION; ARBITRATION; INFERENCE; REWARDS; SYSTEMS;
D O I
10.1038/s41598-023-27609-0
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Humans form complex societies in which we routinely engage in social decision-making regarding the allocation of resources among ourselves and others. One dimension that characterizes social decision-making in particular is whether to prioritize self-interest or respect for others-proself or prosocial. What causes this individual difference in social value orientation? Recent developments in the social dual-process theory argue that social decision-making is characterized by its underlying domain-general learning systems: the model-free and model-based systems. In line with this "learning" approach, we propose and experimentally test the hypothesis that differences in social preferences stem from which learning system is dominant in an individual. Here, we used a non-social state transition task that allowed us to assess the balance between model-free/model-based learning and investigate its relation to the social value orientations. The results showed that proselfs depended more on model-based learning, whereas prosocials depended more on model-free learning. Reward amount and reaction time analyses showed that proselfs learned the task structure earlier in the session than prosocials, reflecting their difference in model-based/model-free learning dependence. These findings support the learning hypothesis on what makes differences in social preferences and have implications for understanding the mechanisms of prosocial behavior.
引用
收藏
页数:15
相关论文
共 33 条
  • [1] Prosocial learning: Model-based or model-free?
    Navidi, Parisa
    Saeedpour, Sepehr
    Ershadmanesh, Sara
    Hossein, Mostafa Miandari
    Bahrami, Bahador
    PLOS ONE, 2023, 18 (06):
  • [2] Extraversion differentiates between model-based and model-free strategies in a reinforcement learning task
    Skatova, Anya
    Chan, Patricia A.
    Daw, Nathaniel D.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
  • [3] Model-based learning retrospectively updates model-free values
    Doody, Max
    Van Swieten, Maaike M. H.
    Manohar, Sanjay G.
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [4] The modulation of acute stress on model-free and model-based reinforcement learning in gambling disorder
    Wyckmans, Florent
    Banerjee, Nilosmita
    Saeremans, Melanie
    Otto, Ross
    Kornreich, Charles
    Vanderijst, Laetitia
    Gruson, Damien
    Carbone, Vincenzo
    Bechara, Antoine
    Buchanan, Tony
    Noel, Xavier
    JOURNAL OF BEHAVIORAL ADDICTIONS, 2022, 11 (03) : 831 - 844
  • [5] Effects of subclinical depression on prefrontal-striatal model-based and model-free learning
    Heo, Suyeon
    Sung, Yoondo
    Lee, Sang Wan
    PLOS COMPUTATIONAL BIOLOGY, 2021, 17 (05)
  • [7] Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
    Dayan, Peter
    Berridge, Kent C.
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2014, 14 (02) : 473 - 492
  • [8] Model-free and model-based learning processes in the updating of explicit and implicit evaluations
    Kurdi, Benedek
    Gershman, Samuel J.
    Banaji, Mahzarin R.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (13) : 6035 - 6044
  • [9] Neural Computations Underlying Arbitration between Model-Based and Model-free Learning
    Lee, Sang Wan
    Shimojo, Shinsuke
    O'Doherty, John P.
    NEURON, 2014, 81 (03) : 687 - 699
  • [10] Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning
    Doll, Bradley B.
    Bath, Kevin G.
    Daw, Nathaniel D.
    Frank, Michael J.
    JOURNAL OF NEUROSCIENCE, 2016, 36 (04) : 1211 - 1222