Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
来源
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE | 2011年 / 1卷 / 04期
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [41] Multimodal Emotion Recognition in Conversation Based on Hypergraphs
    Li, Jiaze
    Mei, Hongyan
    Jia, Liyun
    Zhang, Xing
    ELECTRONICS, 2023, 12 (22)
  • [42] A Novel Transformer-Based Approach for Adult's Facial Emotion Recognition
    Nawaz, Uzma
    Saeed, Zubair
    Atif, Kamran
    IEEE ACCESS, 2025, 13 : 56485 - 56508
  • [43] Facial Emotion Recognition Using Fuzzy Systems
    Nicolai, Austin
    Choi, Anthony
    2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 2216 - 2221
  • [44] Facial Emotion Recognition Using Depth Data
    Szwoch, Mariusz
    Pieniazek, Pawel
    2015 8TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2015, : 271 - 277
  • [45] Multimodal approaches for emotion recognition: A survey
    Sebe, N
    Cohen, I
    Gevers, T
    Huang, TS
    INTERNET IMAGING VI, 2005, 5670 : 56 - 67
  • [46] Emotion recognition model based on facial expressions
    Yadav, Satya Prakash
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (17) : 26357 - 26379
  • [47] Emotion Recognition Based on Occluded Facial Expressions
    Ramirez Cornejo, Jadisha Yarif
    Pedrini, Helio
    IMAGE ANALYSIS AND PROCESSING,(ICIAP 2017), PT I, 2017, 10484 : 309 - 319
  • [48] Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition
    Li, Bobo
    Fei, Hao
    Liao, Lizi
    Zhao, Yu
    Teng, Chong
    Chua, Tat-Seng
    Ji, Donghong
    Li, Fei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5923 - 5934
  • [49] Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition
    Dang, Xiaochao
    Chen, Zetong
    Hao, Zhanjun
    Ga, Macidan
    Han, Xinyu
    Zhang, Xiaotong
    Yang, Jie
    SENSORS, 2023, 23 (01)
  • [50] Training Emotion Recognition Accuracy: Results for Multimodal Expressions and Facial Micro Expressions
    Dollinger, Lillian
    Laukka, Petri
    Hogman, Lennart Bjorn
    Banziger, Tanja
    Makower, Irena
    Fischer, Hakan
    Hau, Stephan
    FRONTIERS IN PSYCHOLOGY, 2021, 12