Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism

被引:0
|
作者
Colaco, Savina Jassica [1 ]
Han, Dong Seog [2 ]
机构
[1] Kyungpook Natl Univ, Ctr ICT & Automot Convergence, Daegu 41566, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
来源
IEEE ACCESS | 2025年 / 13卷
基金
新加坡国家研究基金会;
关键词
Emotion recognition; Face recognition; Feature extraction; Accuracy; Representation learning; Attention mechanisms; Visualization; Scalability; Kernel; Image recognition; Contextual cues; deep learning; emotion recognition; facial landmarks; scalable models; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3534328
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deciphering emotions from a person's perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model's robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.
引用
收藏
页码:20778 / 20791
页数:14
相关论文
共 50 条
  • [1] Convolutional Attention Based Mechanism for Facial Microexpression Recognition
    Talib, Hafiz Khizer Bin
    Xu, Kaiwei
    Cao, Yanlong
    Xu, Yuan-Ping
    Xu, Zhijie
    Zaman, Muhammad
    Akhunzada, Adnan
    IEEE ACCESS, 2025, 13 : 23732 - 23747
  • [2] Emotion Recognition on Selected Facial Landmarks Using Supervised Learning Algorithms
    Baculo, Maria Jeseca C.
    Azcarraga, Judith J.
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 1483 - 1489
  • [3] Hierarchical Context-Based Emotion Recognition With Scene Graphs
    Wu, Shichao
    Zhou, Lei
    Hu, Zhengxi
    Liu, Jingtai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3725 - 3739
  • [4] Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired People
    Mukhiddinov, Mukhriddin
    Djuraev, Oybek
    Akhmedov, Farkhod
    Mukhamadiyev, Abdinabi
    Cho, Jinsoo
    SENSORS, 2023, 23 (03)
  • [5] Facial Emotion Recognition Using Context Based Multimodal Approach
    Metri, Priya
    Ghorpade, Jayshree
    Butalia, Ayesha
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2011, 1 (04): : 13 - 16
  • [6] Region Attention Enhanced Unsupervised Cross-Domain Facial Emotion Recognition
    Ji, Yanli
    Hu, Yuhan
    Yang, Yang
    Shen, Heng Tao
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 4190 - 4201
  • [7] Emotion Recognition using Spatiotemporal Features from Facial Expression Landmarks
    Golzadeh, Hamid
    Faria, Diego R.
    Manso, Luis J.
    Ekart, Aniko
    Buckingham, Christopher D.
    2018 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS (IS), 2018, : 789 - 794
  • [8] Facial Expression Recognition Based on Feature Representation Learning and Clustering-Based Attention Mechanism
    Jin, Lianghai
    Guo, Liyuan
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2025, 7 (02): : 182 - 194
  • [9] A Novel Transformer-Based Approach for Adult's Facial Emotion Recognition
    Nawaz, Uzma
    Saeed, Zubair
    Atif, Kamran
    IEEE ACCESS, 2025, 13 : 56485 - 56508
  • [10] GA-SVM-Based Facial Emotion Recognition Using Facial Geometric Features
    Liu, Xiao
    Cheng, Xiangyi
    Lee, Kiju
    IEEE SENSORS JOURNAL, 2021, 21 (10) : 11532 - 11542