Social Concepts Simplify Complex Reinforcement Learning

被引:2
|
作者
Hackel, Leor M. [1 ]
Kalkstein, David A. [2 ]
机构
[1] Univ Southern Calif, Dept Psychol, Los Angeles, CA 90007 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA USA
关键词
concepts; generalization; reinforcement learning; relational reasoning; rewards; social cognition; open data; open materials; preregistered; RELATIONAL LANGUAGE; INFERENCES; KNOWLEDGE; SELECTION; CHOICES;
D O I
10.1177/09567976231180587
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Humans often generalize rewarding experiences across abstract social roles. Theories of reward learning suggest that people generalize through model-based learning, but such learning is cognitively costly. Why do people seem to generalize across social roles with ease? Humans are social experts who easily recognize social roles that reflect familiar semantic concepts (e.g., "helper" or "teacher"). People may associate these roles with model-free reward (e.g., learning that helpers are rewarding), allowing them to generalize easily (e.g., interacting with novel individuals identified as helpers). In four online experiments with U.S. adults (N = 577), we found evidence that social concepts ease complex learning (people generalize more and at faster speed) and that people attach reward directly to abstract roles (they generalize even when roles are unrelated to task structure). These results demonstrate how familiar concepts allow complex behavior to emerge from simple strategies, highlighting social interaction as a prototype for studying cognitive ease in the face of environmental complexity.
引用
收藏
页码:968 / 983
页数:16
相关论文
共 50 条
  • [31] Concepts and facilities of a neural reinforcement learning control architecture for technical process control
    Riedmiller, M
    NEURAL COMPUTING & APPLICATIONS, 1999, 8 (04) : 323 - 338
  • [32] Learning to Navigate Through Complex Dynamic Environment With Modular Deep Reinforcement Learning
    Wang, Yuanda
    He, Haibo
    Sun, Changyin
    IEEE TRANSACTIONS ON GAMES, 2018, 10 (04) : 400 - 412
  • [33] Learning the Selection of Actions for an Autonomous Social Robot by Reinforcement Learning Based on Motivations
    Álvaro Castro-González
    María Malfaz
    Miguel A. Salichs
    International Journal of Social Robotics, 2011, 3 : 427 - 441
  • [34] Learning the Selection of Actions for an Autonomous Social Robot by Reinforcement Learning Based on Motivations
    Castro-Gonzalez, Alvaro
    Malfaz, Maria
    Salichs, Miguel A.
    INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2011, 3 (04) : 427 - 441
  • [35] Reinforcement learning agents providing advice in complex video games
    Taylor, Matthew E.
    Carboni, Nicholas
    Fachantidis, Anestis
    Vlahavas, Ioannis
    Torrey, Lisa
    CONNECTION SCIENCE, 2014, 26 (01) : 45 - 63
  • [36] Social Navigation with Human Empowerment Driven Deep Reinforcement Learning
    van der Heiden, Tessa
    Mirus, Florian
    van Hoof, Herke
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 395 - 407
  • [37] A Reinforcement Learning Framework to Foster Affective Empathy in Social Robots
    Sorrentino, Alessandra
    Assuncao, Gustavo
    Cavallo, Filippo
    Fiorini, Laura
    Menezes, Paulo
    SOCIAL ROBOTICS, ICSR 2022, PT I, 2022, 13817 : 522 - 533
  • [38] Integrating Reinforcement Learning with Models of Representation Learning
    Jones, Matt
    Canas, Fabian
    COGNITION IN FLUX, 2010, : 1258 - 1263
  • [39] A Reinforcement Learning Approach to Gaining Social Capital with Partial Observation
    Zhao, He
    Su, Hongyi
    Chen, Yang
    Liu, Jiamou
    Zheng, Hong
    Yan, Bo
    PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2019, 11670 : 113 - 117
  • [40] Reinforcement Learning based Search (RLS) algorithm in Social Networks
    Peyravi, Farzad
    Derhami, Vali
    Latif, Alimohammad
    2015 INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING (AISP), 2015, : 206 - 210