ChatGPT outperforms humans in emotional awareness evaluations

被引:104
作者
Elyoseph, Zohar [1 ,2 ]
Hadar-Shoval, Dorit [1 ]
Asraf, Kfir [3 ]
Lvovsky, Maya [3 ]
机构
[1] Max Stern Yezreel Valley Coll, Ctr Psychobiol Res, Dept Psychol & Educ Counseling, Emek Yezreel, Israel
[2] Imperial Coll London, Fac Med, Dept Brain Sci, London, England
[3] Max Stern Yezreel Valley Coll, Ctr Psychobiol Res, Psychol Dept, Emek Yezreel, Israel
来源
FRONTIERS IN PSYCHOLOGY | 2023年 / 14卷
关键词
ChatGPT; emotional awareness; LEAS; artificial intelligence; emotional intelligence; psychological assessment; psychotherapy; DEFICITS; ALEXITHYMIA; SCALE; MIND;
D O I
10.3389/fpsyg.2023.1199058
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The artificial intelligence chatbot, ChatGPT, has gained widespread attention for its ability to perform natural language processing tasks and has the fastest-growing user base in history. Although ChatGPT has successfully generated theoretical information in multiple fields, its ability to identify and describe emotions is still unknown. Emotional awareness (EA), the ability to conceptualize one's own and others' emotions, is considered a transdiagnostic mechanism for psychopathology. This study utilized the Levels of Emotional Awareness Scale (LEAS) as an objective, performance-based test to analyze ChatGPT's responses to twenty scenarios and compared its EA performance with that of the general population norms, as reported by a previous study. A second examination was performed one month later to measure EA improvement over time. Finally, two independent licensed psychologists evaluated the fit-to-context of ChatGPT's EA responses. In the first examination, ChatGPT demonstrated significantly higher performance than the general population on all the LEAS scales (Z score = 2.84). In the second examination, ChatGPT's performance significantly improved, almost reaching the maximum possible LEAS score (Z score = 4.26). Its accuracy levels were also extremely high (9.7/10). The study demonstrated that ChatGPT can generate appropriate EA responses, and that its performance may improve significantly over time. The study has theoretical and clinical implications, as ChatGPT can be used as part of cognitive training for clinical populations with EA impairments. In addition, ChatGPT's EA-like abilities may facilitate psychiatric diagnosis and assessment and be used to enhance emotional language. Further research is warranted to better understand the potential benefits and risks of ChatGPT and refine it to promote mental health.
引用
收藏
页数:7
相关论文
共 44 条
  • [1] Agosta L., 2018, Theory and practice of online therapy, P34
  • [2] THE 20-ITEM TORONTO-ALEXITHYMIA-SCALE .1. ITEM SELECTION AND CROSS-VALIDATION OF THE FACTOR STRUCTURE
    BAGBY, RM
    PARKER, JDA
    TAYLOR, GJ
    [J]. JOURNAL OF PSYCHOSOMATIC RESEARCH, 1994, 38 (01) : 23 - 32
  • [3] Bar-On Reuven., 2000, HDB EMOTIONAL INTELL, P363
  • [4] The "Reading the Mind in the Eyes" test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism
    Baron-Cohen, S
    Wheelwright, S
    Hill, J
    Raste, Y
    Plumb, I
    [J]. JOURNAL OF CHILD PSYCHOLOGY AND PSYCHIATRY, 2001, 42 (02) : 241 - 251
  • [5] Deficits in Emotional Awareness in Schizophrenia and Their Relationship With Other Measures of Functioning
    Baslet, Gaston
    Termini, Lindsay
    Herbener, Ellen
    [J]. JOURNAL OF NERVOUS AND MENTAL DISEASE, 2009, 197 (09) : 655 - 660
  • [6] CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING
    BENJAMINI, Y
    HOCHBERG, Y
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) : 289 - 300
  • [7] The curse of knowledge in reasoning about false beliefs
    Birch, Susan A. J.
    Bloom, Paul
    [J]. PSYCHOLOGICAL SCIENCE, 2007, 18 (05) : 382 - 386
  • [8] From Maps to Multi-dimensional Network Mechanisms of Mental Disorders
    Braun, Urs
    Schaefer, Axel
    Betzel, Richard F.
    Tost, Heike
    Meyer-Lindenberg, Andreas
    Bassett, Danielle S.
    [J]. NEURON, 2018, 97 (01) : 14 - 31
  • [9] The effects of a novel psychological attribution and emotional awareness and expression therapy for chronic musculoskeletal pain: A preliminary, uncontrolled trial
    Burger, Amanda J.
    Lumley, Mark A.
    Carty, Jennifer N.
    Latsch, Deborah V.
    Thakur, Elyse R.
    Hyde-Nolan, Maren E.
    Hijazi, Alaa M.
    Schubiner, Howard
    [J]. JOURNAL OF PSYCHOSOMATIC RESEARCH, 2016, 81 : 1 - 8
  • [10] Emotion-processing deficits in eating disorders
    Bydlowski, S
    Corcos, M
    Jeammet, P
    Paterniti, S
    Berthoz, S
    Laurier, C
    Chambry, J
    Consoli, SM
    [J]. INTERNATIONAL JOURNAL OF EATING DISORDERS, 2005, 37 (04) : 321 - 329