Using large language models in psychology

被引:97
作者
Demszky, Dorottya [1 ]
Yang, Diyi [2 ]
Yeager, David [3 ,4 ]
Bryan, Christopher [3 ,5 ]
Clapper, Margarett [3 ,4 ]
Chandhok, Susannah [6 ]
Eichstaedt, Johannes [7 ,8 ]
Hecht, Cameron [3 ,4 ]
Jamieson, Jeremy [9 ]
Johnson, Meghann [3 ]
Jones, Michaela [3 ]
Krettek-Cobb, Danielle [6 ]
Lai, Leslie [6 ]
Jonesmitchell, Nirel [3 ]
Ong, Desmond [3 ,4 ]
Dweck, Carol [7 ]
Gross, James [7 ]
Pennebaker, James [4 ]
机构
[1] Stanford Univ, Grad Sch Educ, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[3] Univ Texas Austin, Texas Behav Sci & Policy Inst, Austin, TX 78712 USA
[4] Univ Texas Austin, Dept Psychol, Austin, TX 78712 USA
[5] Univ Texas Austin, Dept Business Govt & Soc, Austin, TX 78712 USA
[6] Google LLC, Mountain View, CA USA
[7] Stanford Univ, Dept Psychol, Stanford, CA USA
[8] Stanford Univ, Inst Human Ctr AI, Stanford, CA USA
[9] Univ Rochester, Dept Psychol, Rochester, NY USA
来源
NATURE REVIEWS PSYCHOLOGY | 2023年 / 2卷 / 11期
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
RESPONSES; MINDSET; STRESS;
D O I
10.1038/s44159-023-00241-5
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Large language models (LLMs), such as OpenAI's GPT-4, Google's Bard or Meta's LLaMa, have created unprecedented opportunities for analysing and generating language data on a massive scale. Because language data have a central role in all areas of psychology, this new technology has the potential to transform the field. In this Perspective, we review the foundations of LLMs. We then explain how the way that LLMs are constructed enables them to effectively generate human-like linguistic output without the ability to think or feel like a human. We argue that although LLMs have the potential to advance psychological measurement, experimentation and practice, they are not yet ready for many of the most transformative psychological applications - but further research and development may enable such use. Next, we examine four major concerns about the application of LLMs to psychology, and how each might be overcome. Finally, we conclude with recommendations for investments that could help to address these concerns: field-initiated 'keystone' datasets; increased standardization of performance benchmarks; and shared computing and analysis infrastructure to ensure that the future of LLM-powered research is equitable. Large language models (LLMs), which can generate and score text in human-like ways, have the potential to advance psychological measurement, experimentation and practice. In this Perspective, Demszky and colleagues describe how LLMs work, concerns about using them for psychological purposes, and how these concerns might be addressed.
引用
收藏
页码:688 / 701
页数:14
相关论文
共 118 条
  • [21] Boyd RL, 2021, J LANG SOC PSYCHOL, V40, P21, DOI [10.1177/0261927X20967028, 10.1177/0261927x20967028]
  • [22] Brady W. J., 2023, PREPRINT, DOI DOI 10.31219/OSF.IO/YW5AH
  • [23] An Ideological Asymmetry in the Diffusion of Moralized Content on Social Media Among Political Leaders
    Brady, William J.
    Wills, Julian A.
    Burkart, Dominic
    Jost, John T.
    Van Bavel, Jay J.
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2019, 148 (10) : 1802 - 1813
  • [24] Brown T., 2020, Advances in Neural Information Processing Systems, V331, P877
  • [25] The mixed effects of online diversity training
    Chang, Edward H.
    Milkman, Katherine L.
    Gromet, Dena M.
    Rebele, Robert W.
    Massey, Cade
    Duckworth, Angela L.
    Grant, Adam M.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (16) : 7778 - 7783
  • [26] Chang J., 2009, Proceedings of the 2009 Conference Advances in Neural Information, P288, DOI DOI 10.5555/2984093.2984126
  • [27] Masculine Defaults: Identifying and Mitigating Hidden Cultural Biases
    Cheryan, Sapna
    Markus, Hazel Rose
    [J]. PSYCHOLOGICAL REVIEW, 2020, 127 (06) : 1022 - 1052
  • [28] The inherence heuristic: An intuitive means of making sense of the world, and a potential precursor to psychological essentialism
    Cimpian, Andrei
    Salomon, Erika
    [J]. BEHAVIORAL AND BRAIN SCIENCES, 2014, 37 (05) : 461 - 480
  • [29] Clapper M., 2023, P WORKSH EQ DIV INCL
  • [30] Collins E., 2021, LAMDA OUR BREAKTHROU