Large Language Models for Emotion Evolution Prediction

被引:0
作者
Leung, Clement [1 ,2 ]
Xu, Zhifei [1 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen, Peoples R China
[2] Chinese Univ Hong Kong, Guangdong Prov Key Lab Future Networks Intelligen, Shenzhen, Peoples R China
来源
COMPUTATIONAL SCIENCE AND ITS APPLICATIONS-ICCSA 2024 WORKSHOPS, PT I | 2024年 / 14815卷
关键词
image emotion prediction; Large Language Model; ChatGPT4; zero-shot; RECOGNITION;
D O I
10.1007/978-3-031-65154-0_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In numerous tasks, especially those of critical safety importance, it is essential that the human participants maintain appropriate emotional states. Recognizing these emotional states accurately has become a key focus, with mainstream approaches typically leveraging Pre-trained Language Models (PLMs) to integrate emotional insights. Recent advancements in Large Language Models (LLMs), like ChatGPT, have shown impressive proficiency in a range of natural language processing applications. Yet, the exploration into ChatGPT's zero-shot capabilities in the realm of image-based emotion recognition and analysis has been notably under-examined. In our research, we study the classification and prediction of emotions, distinguishing between positive and negative states, and we critically assess the ability of ChatGPT4 to recognize emotions from images, putting a spotlight on its potential in this area. The experimental results show that ChatGPT4 can effectively predict the evolution of emotion, and the accuracy of the evolution of positive and negative emotions is more than expected. However, ChatGPT4's prediction of specific negative emotions has gaps.
引用
收藏
页码:3 / 19
页数:17
相关论文
共 29 条
  • [1] Brown TB, 2020, Arxiv, DOI [arXiv:2005.14165, DOI 10.48550/ARXIV.2005.14165]
  • [2] Ciraolo D., 2023, 2023 IEEE S COMP COM, P1
  • [3] Multimodal Emotion Recognition Using Transfer Learning on Audio and Text Data
    Deng, James J.
    Leung, Clement H. C.
    Li, Yuanxi
    [J]. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS, ICCSA 2021, PT III, 2021, 12951 : 552 - 563
  • [4] Towards Learning a Joint Representation from Transformer in Multimodal Emotion Recognition
    Deng, James J.
    Leung, Clement H. C.
    [J]. BRAIN INFORMATICS, BI 2021, 2021, 12960 : 179 - 188
  • [5] FACIAL EXPRESSIONS OF EMOTION - NEW FINDINGS, NEW QUESTIONS
    EKMAN, P
    [J]. PSYCHOLOGICAL SCIENCE, 1992, 3 (01) : 34 - 38
  • [6] An introduction to ROC analysis
    Fawcett, Tom
    [J]. PATTERN RECOGNITION LETTERS, 2006, 27 (08) : 861 - 874
  • [7] Multimodal Emotion Recognition with Deep Learning: Advancements, challenges, and future directions
    Geetha, A., V
    Mala, T.
    Priyanka, D.
    Uma, E.
    [J]. INFORMATION FUSION, 2024, 105
  • [8] Speech emotion recognition with deep convolutional neural networks
    Issa, Dias
    Demirci, M. Fatih
    Yazici, Adnan
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 59
  • [9] Context Based Emotion Recognition Using EMOTIC Dataset
    Kosti, Ronak
    Alvarez, Jose M.
    Recasens, Adria
    Lapedriza, Agata
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (11) : 2755 - 2766
  • [10] Emotion Recognition in Context
    Kosti, Ronak
    Alvarez, Jose M.
    Recasens, Adria
    Lapedriza, Agata
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1960 - 1968