Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
来源
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE | 2011年 / 1卷 / 04期
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [1] A Multimodal Emotion Recognition System Using Facial Landmark Analysis
    Farhad Rahdari
    Esmat Rashedi
    Mahdi Eftekhari
    Iranian Journal of Science and Technology, Transactions of Electrical Engineering, 2019, 43 : 171 - 189
  • [2] A Multimodal Emotion Recognition System Using Facial Landmark Analysis
    Rahdari, Farhad
    Rashedi, Esmat
    Eftekhari, Mahdi
    IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2019, 43 (Suppl 1) : 171 - 189
  • [3] A multimodal emotion recognition method based on facial expressions and electroencephalography
    Tan, Ying
    Sun, Zhe
    Duan, Feng
    Sole-Casals, Jordi
    Caiafa, Cesar F.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 70
  • [4] Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG
    Pan, Jiahui
    Fang, Weijie
    Zhang, Zhihang
    Chen, Bingzhi
    Zhang, Zheng
    Wang, Shuihua
    IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY, 2024, 5 : 396 - 403
  • [5] Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
    Colaco, Savina Jassica
    Han, Dong Seog
    IEEE ACCESS, 2025, 13 : 20778 - 20791
  • [6] A Fuzzy Approach for Facial Emotion Recognition
    Farahani, Fatemeh Shahrabi
    Sheikhan, Mansour
    Farrokhi, Ali
    2013 13TH IRANIAN CONFERENCE ON FUZZY SYSTEMS (IFSC), 2013,
  • [7] Use of multimodal information in facial emotion recognition
    De Silva, LC
    Miyasato, T
    Nakatsu, R
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 1998, E81D (01) : 105 - 114
  • [8] Multimodal approach for emotion recognition using an algebraic representation of emotional states
    Meftah, Imen Tayari
    Nhan Le Thanh
    Ben Amar, Chokri
    8TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS 2012), 2012, : 541 - 546
  • [9] Context-Sensitive Multimodal Emotion Recognition from Speech and Facial Expression using Bidirectional LSTM Modeling
    Woellmer, Martin
    Metallinou, Angeliki
    Eyben, Florian
    Schuller, Bjoern
    Narayanan, Shrikanth
    11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, 2010, : 2362 - +
  • [10] Multimodal Emotion Recognition Using Feature Fusion: An LLM-Based Approach
    Chandraumakantham, Omkumar
    Gowtham, N.
    Zakariah, Mohammed
    Almazyad, Abdulaziz
    IEEE ACCESS, 2024, 12 : 108052 - 108071