Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
来源
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE | 2011年 / 1卷 / 04期
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [31] Emotion recognition based on facial components
    Rani, P. Ithaya
    Muneeswaran, K.
    SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 2018, 43 (03):
  • [32] Automating facial emotion recognition
    Gervasi, Osvaldo
    Franzoni, Valentina
    Riganelli, Matteo
    Tasso, Sergio
    WEB INTELLIGENCE, 2019, 17 (01) : 17 - 27
  • [33] Human Emotion Recognition by Integrating Facial and Speech Features: An Implementation of Multimodal Framework using CNN
    Srinivas, P. V. V. S.
    Mishra, Pragnyaban
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (01) : 592 - 603
  • [34] End-to-End Multimodal Emotion Recognition Based on Facial Expressions and Remote Photoplethysmography Signals
    Li, Jixiang
    Peng, Jianxin
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (10) : 6054 - 6063
  • [35] GA-SVM-Based Facial Emotion Recognition Using Facial Geometric Features
    Liu, Xiao
    Cheng, Xiangyi
    Lee, Kiju
    IEEE SENSORS JOURNAL, 2021, 21 (10) : 11532 - 11542
  • [36] Emotion Recognition Based on Decoupling the Spatial Context from the Temporal Dynamics of Facial Expressions
    Alazrai, Rami
    Yousef, Khalil M. Ahmad
    Daoud, Mohammad I.
    2019 INTERNATIONAL SYMPOSIUM ON NETWORKS, COMPUTERS AND COMMUNICATIONS (ISNCC 2019), 2019,
  • [37] Multimodal Emotion Recognition Based on the Decoupling of Emotion and Speaker Information
    Gajsek, Rok
    Struc, Vitomir
    Mihelic, France
    TEXT, SPEECH AND DIALOGUE, 2010, 6231 : 275 - 282
  • [38] Emotion Recognition Using Multimodal Deep Learning
    Liu, Wei
    Zheng, Wei-Long
    Lu, Bao-Liang
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT II, 2016, 9948 : 521 - 529
  • [39] Multimodal Emotion Recognition Using Deep Networks
    Fadil, C.
    Alvarez, R.
    Martinez, C.
    Goddard, J.
    Rufiner, H.
    VI LATIN AMERICAN CONGRESS ON BIOMEDICAL ENGINEERING (CLAIB 2014), 2014, 49 : 813 - 816
  • [40] HYBRID FUSION BASED APPROACH FOR MULTIMODAL EMOTION RECOGNITION WITH INSUFFICIENT LABELED DATA
    Kumar, Puneet
    Khokher, Vedanti
    Gupta, Yukti
    Raman, Balasubramanian
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 314 - 318