Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
来源
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE | 2011年 / 1卷 / 04期
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [21] Multimodal Emotion Recognition From EEG Signals and Facial Expressions
    Wang, Shuai
    Qu, Jingzi
    Zhang, Yong
    Zhang, Yidie
    IEEE ACCESS, 2023, 11 : 33061 - 33068
  • [22] Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis
    Loic Kessous
    Ginevra Castellano
    George Caridakis
    Journal on Multimodal User Interfaces, 2010, 3 : 33 - 48
  • [23] Emotion Recognition using Multimodal Features
    Zhao, Jinming
    Chen, Shizhe
    Wang, Shuai
    Jin, Qin
    2018 FIRST ASIAN CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII ASIA), 2018,
  • [24] Multimodal machine learning approach for emotion recognition using physiological signals
    Ramadan, Mohamad A.
    Salem, Nancy M.
    Mahmoud, Lamees N.
    Sadek, Ibrahim
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [25] Context Based Emotion Recognition Using EMOTIC Dataset
    Kosti, Ronak
    Alvarez, Jose M.
    Recasens, Adria
    Lapedriza, Agata
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (11) : 2755 - 2766
  • [26] Emotion recognition using facial expressions
    Tarnowski, Pawel
    Kolodziej, Marcin
    Majkowski, Andrzej
    Rak, Remigiusz J.
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 1175 - 1184
  • [27] Emotion Recognition System Based on Facial Expressions Using SVM
    Abdul-Majjed, Ielaf Osaamah
    RECENT DEVELOPMENTS IN INTELLIGENT COMPUTING, COMMUNICATION AND DEVICES, ICCD 2016, 2017, 555 : 31 - 35
  • [28] Facial Expression Based Emotion Recognition Using Neural Networks
    Yagis, Ekin
    Unel, Mustafa
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 : 210 - 217
  • [29] Facial Emotion Recognition Based on CNN
    Liu, Shuang
    Li, Dahua
    Gao, Qiang
    Song, Yu
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 398 - 403
  • [30] Emotion recognition based on facial components
    P ITHAYA RANI
    K MUNEESWARAN
    Sādhanā, 2018, 43