Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism

被引:1
作者
Colaco, Savina Jassica [1 ]
Han, Dong Seog [2 ]
机构
[1] Kyungpook Natl Univ, Ctr ICT & Automot Convergence, Daegu 41566, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
基金
新加坡国家研究基金会;
关键词
Emotion recognition; Face recognition; Feature extraction; Accuracy; Representation learning; Attention mechanisms; Visualization; Scalability; Kernel; Image recognition; Contextual cues; deep learning; emotion recognition; facial landmarks; scalable models; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3534328
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deciphering emotions from a person's perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model's robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.
引用
收藏
页码:20778 / 20791
页数:14
相关论文
共 50 条
[31]   EmoTrans attention based emotion recognition using EEG signals and facial analysis with expert validation [J].
Ul Hassan, Ch Anwar ;
Ehatisham-ul-Haq, Muhammad ;
Murtaza, Fiza ;
Yasin, Aman Ullah ;
Ullah, Syed Sajid .
SCIENTIFIC REPORTS, 2025, 15 (01)
[32]   Toward Personalized Emotion Recognition: A Face Recognition Based Attention Method for Facial Emotion Recognition [J].
Shahabinejad, Mostafa ;
Wang, Yang ;
Yu, Yuanhao ;
Tang, Jin ;
Li, Jiani .
2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
[33]   Multiscale Facial Expression Recognition Based on Dynamic Global and Static Local Attention [J].
Xu, Jie ;
Li, Yang ;
Yang, Guanci ;
He, Ling ;
Luo, Kexin .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2025, 16 (02) :683-696
[34]   The effects of context on facial affect recognition [J].
Milanak, Melissa E. ;
Berenbaum, Howard .
MOTIVATION AND EMOTION, 2014, 38 (04) :560-568
[35]   LAUN Improved StarGAN for Facial Emotion Recognition [J].
Wang, Xiaohua ;
Gong, Jianqiao ;
Hu, Min ;
Gu, Yu ;
Ren, Fuji .
IEEE ACCESS, 2020, 8 :161509-161518
[36]   Emotion Recognition from Videos Using Facial Expressions [J].
Selvi, P. Tamil ;
Vyshnavi, P. ;
Jagadish, R. ;
Srikumar, Shravan ;
Veni, S. .
ARTIFICIAL INTELLIGENCE AND EVOLUTIONARY COMPUTATIONS IN ENGINEERING SYSTEMS, ICAIECES 2016, 2017, 517 :565-576
[37]   Deep facial emotion recognition in video using eigenframes [J].
Hajarolasvadi, Noushin ;
Demirel, Hasan .
IET IMAGE PROCESSING, 2020, 14 (14) :3536-3546
[38]   Grey Wolf optimisation-based feature selection and classification for facial emotion recognition [J].
Sreedharan, Ninu Preetha Nirmala ;
Ganesan, Brammya ;
Raveendran, Ramya ;
Sarala, Praveena ;
Dennis, Binu ;
Boothalingam, Rajakumar R. .
IET BIOMETRICS, 2018, 7 (05) :490-499
[39]   Facial Emotion Recognition using Min-Max Similarity Classifier [J].
Krestinskaya, Olga ;
James, Alex Pappachen .
2017 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2017, :752-758
[40]   Deep Learning Based Facial Emotion Recognition System [J].
Ozdemir, Mehmet Akif ;
Elagoz, Berkay ;
Soy, Aysegul Alaybeyoglu ;
Akan, Aydin .
2020 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2020,