Social Concepts Simplify Complex Reinforcement Learning

被引:2
|
作者
Hackel, Leor M. [1 ]
Kalkstein, David A. [2 ]
机构
[1] Univ Southern Calif, Dept Psychol, Los Angeles, CA 90007 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA USA
关键词
concepts; generalization; reinforcement learning; relational reasoning; rewards; social cognition; open data; open materials; preregistered; RELATIONAL LANGUAGE; INFERENCES; KNOWLEDGE; SELECTION; CHOICES;
D O I
10.1177/09567976231180587
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Humans often generalize rewarding experiences across abstract social roles. Theories of reward learning suggest that people generalize through model-based learning, but such learning is cognitively costly. Why do people seem to generalize across social roles with ease? Humans are social experts who easily recognize social roles that reflect familiar semantic concepts (e.g., "helper" or "teacher"). People may associate these roles with model-free reward (e.g., learning that helpers are rewarding), allowing them to generalize easily (e.g., interacting with novel individuals identified as helpers). In four online experiments with U.S. adults (N = 577), we found evidence that social concepts ease complex learning (people generalize more and at faster speed) and that people attach reward directly to abstract roles (they generalize even when roles are unrelated to task structure). These results demonstrate how familiar concepts allow complex behavior to emerge from simple strategies, highlighting social interaction as a prototype for studying cognitive ease in the face of environmental complexity.
引用
收藏
页码:968 / 983
页数:16
相关论文
共 50 条
  • [1] Social Anxiety and Dynamic Social Reinforcement Learning in a Volatile Environment
    Beltzer, Miranda L.
    Adams, Stephen
    Beling, Peter A.
    Teachman, Bethany A.
    CLINICAL PSYCHOLOGICAL SCIENCE, 2019, 7 (06) : 1372 - 1388
  • [2] Learning from other minds: an optimistic critique of reinforcement learning models of social learning
    Lez, Natalia Velez
    Gweon, Hyowon
    CURRENT OPINION IN BEHAVIORAL SCIENCES, 2021, 38 : 110 - 115
  • [3] Examining social reinforcement learning in social anxiety
    Beltzer, Miranda L.
    Daniel, Katharine E.
    Daros, Alexander R.
    Teachman, Bethany A.
    JOURNAL OF BEHAVIOR THERAPY AND EXPERIMENTAL PSYCHIATRY, 2023, 80
  • [4] Complex problem solving with reinforcement learning
    Dandurand, Frederic
    Shultz, Thomas R.
    Rivest, Francois
    2007 IEEE 6TH INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, 2007, : 22 - +
  • [5] Reinforcement learning on complex visual stimuli
    Niko Wilbert
    Robert Legenstein
    Mathias Franzius
    Laurenz Wiskott
    BMC Neuroscience, 10 (Suppl 1)
  • [6] Learning More Complex Actions with Deep Reinforcement Learning
    Wang, Chenxi
    Du, Youtian
    Xie, Shengyuan
    Lu, Yongdi
    2021 FIFTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2021), 2021, : 121 - 122
  • [7] Reinforcement Learning Dynamics in Social Dilemmas
    Izquierdo, Segismundo S.
    Izquierdo, Luis R.
    Gotts, Nicholas M.
    JASSS-THE JOURNAL OF ARTIFICIAL SOCIETIES AND SOCIAL SIMULATION, 2008, 11 (02):
  • [8] Social Reinforcement Learning in Game Playing
    Kiourt, Chairi
    Kalles, Dimitris
    2012 IEEE 24TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2012), VOL 1, 2012, : 322 - 326
  • [9] Reinforcement Learning Approaches in Social Robotics
    Akalin, Neziha
    Loutfi, Amy
    SENSORS, 2021, 21 (04) : 1 - 37
  • [10] Ethological Concepts in Hierarchical Reinforcement Learning and Control of Intelligent Agents
    Nahodil, Pavel
    23RD EUROPEAN CONFERENCE ON MODELLING AND SIMULATION (ECMS 2009), 2009, : 180 - 186