Using large language models in psychology

被引:97
作者
Demszky, Dorottya [1 ]
Yang, Diyi [2 ]
Yeager, David [3 ,4 ]
Bryan, Christopher [3 ,5 ]
Clapper, Margarett [3 ,4 ]
Chandhok, Susannah [6 ]
Eichstaedt, Johannes [7 ,8 ]
Hecht, Cameron [3 ,4 ]
Jamieson, Jeremy [9 ]
Johnson, Meghann [3 ]
Jones, Michaela [3 ]
Krettek-Cobb, Danielle [6 ]
Lai, Leslie [6 ]
Jonesmitchell, Nirel [3 ]
Ong, Desmond [3 ,4 ]
Dweck, Carol [7 ]
Gross, James [7 ]
Pennebaker, James [4 ]
机构
[1] Stanford Univ, Grad Sch Educ, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[3] Univ Texas Austin, Texas Behav Sci & Policy Inst, Austin, TX 78712 USA
[4] Univ Texas Austin, Dept Psychol, Austin, TX 78712 USA
[5] Univ Texas Austin, Dept Business Govt & Soc, Austin, TX 78712 USA
[6] Google LLC, Mountain View, CA USA
[7] Stanford Univ, Dept Psychol, Stanford, CA USA
[8] Stanford Univ, Inst Human Ctr AI, Stanford, CA USA
[9] Univ Rochester, Dept Psychol, Rochester, NY USA
来源
NATURE REVIEWS PSYCHOLOGY | 2023年 / 2卷 / 11期
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
RESPONSES; MINDSET; STRESS;
D O I
10.1038/s44159-023-00241-5
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Large language models (LLMs), such as OpenAI's GPT-4, Google's Bard or Meta's LLaMa, have created unprecedented opportunities for analysing and generating language data on a massive scale. Because language data have a central role in all areas of psychology, this new technology has the potential to transform the field. In this Perspective, we review the foundations of LLMs. We then explain how the way that LLMs are constructed enables them to effectively generate human-like linguistic output without the ability to think or feel like a human. We argue that although LLMs have the potential to advance psychological measurement, experimentation and practice, they are not yet ready for many of the most transformative psychological applications - but further research and development may enable such use. Next, we examine four major concerns about the application of LLMs to psychology, and how each might be overcome. Finally, we conclude with recommendations for investments that could help to address these concerns: field-initiated 'keystone' datasets; increased standardization of performance benchmarks; and shared computing and analysis infrastructure to ensure that the future of LLM-powered research is equitable. Large language models (LLMs), which can generate and score text in human-like ways, have the potential to advance psychological measurement, experimentation and practice. In this Perspective, Demszky and colleagues describe how LLMs work, concerns about using them for psychological purposes, and how these concerns might be addressed.
引用
收藏
页码:688 / 701
页数:14
相关论文
共 118 条
  • [41] Gaddis M, 2018, Audit Studies: Behind the Scenes with Theory, Method, and Nuance, P3, DOI [DOI 10.1007/978-3-319-71153-9_1, 10.1007/978-3-319-71153-9_1]
  • [42] Gehrmann S, 2021, 1ST WORKSHOP ON NATURAL LANGUAGE GENERATION, EVALUATION, AND METRICS (GEM 2021), P96
  • [43] Goneni H, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P609
  • [44] Antecedent- and response-focused emotion regulation: Divergent consequences for experience, expression, and physiology
    Gross, JJ
    [J]. JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1998, 74 (01) : 224 - 237
  • [45] Guest O., 2023, Comput. Brain Behav, V6, P213, DOI [DOI 10.1007/S42113-022-00166-X, 10.1007/s42113-022-00166-x]
  • [46] Harris C., 2022, 2022 ACM C FAIRN ACC, P789
  • [47] Heaven, 2020, GOOGL MED AI WAS SUP
  • [48] Efficiently exploring the causal role of contextual moderators in behavioral science
    Hecht, Cameron A.
    Dweck, Carol S.
    Murphy, Mary C.
    Kroeper, Kathryn M.
    Yeager, David S.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2022, 120 (01)
  • [49] Beliefs, affordances, and adolescent development: Lessons from a decade of growth mindset interventions
    Hecht, Cameron A.
    Yeager, David S.
    Dweck, Carol S.
    Murphy, Mary C.
    [J]. ADVANCES IN CHILD DEVELOPMENT AND BEHAVIOR, VOL 61, 2021, 61 : 169 - 197
  • [50] "Beautiful work, you're rock stars!": Teacher Analytics to Uncover Discourse that Supports or Undermines Student Motivation, Identity, and Belonging in Classrooms
    Hunkins, Nicholas C.
    Kelly, Sean
    D'Mello, Sidney K.
    [J]. LAK22 CONFERENCE PROCEEDINGS: THE TWELFTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE, 2022, : 230 - 238