A Novel Transformer-Based Approach for Adult's Facial Emotion Recognition

被引:0
|
作者
Nawaz, Uzma [1 ]
Saeed, Zubair [2 ,3 ]
Atif, Kamran [4 ]
机构
[1] Natl Univ Sci & Technol, Coll Elect & Mech Engn, Knowledge & Data Sci Res Ctr, Dept Comp & Software Engn, Islamabad 44000, Pakistan
[2] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX 77840 USA
[3] Texas A&M Univ Qatar, Dept Elect & Comp Engn, Doha, Qatar
[4] Deakin Univ, Dept Civil Engn, Melbourne, Vic 3125, Australia
来源
IEEE ACCESS | 2025年 / 13卷
关键词
Emotion recognition; Transformers; Face recognition; Accuracy; Brain modeling; Real-time systems; Adaptation models; Lighting; Human computer interaction; Facial features; Facial emotion recognition; transformers; deep learning; FER2013; CK plus; AffectNet; AFEW; RAF-DB; emotion recognition; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3555510
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Adult facial expression recognition (FER) is essential for human-computer interaction, mental health assessment, and social robotics applications because it improves user experiences and emotional well-being. This study presents a novel attention mechanism-based transformer approach designed to capture detailed patterns in facial features and dynamically focus on the most relevant regions for enhanced accuracy. Unlike conventional deep learning approaches, our method integrates an adaptive attention mechanism and dynamic token pruning, which optimizes computational efficiency while maintaining high accuracy. The model is evaluated on five widely used datasets: FER2013, CK+, AffectNet, RAF-DB, and AFEW. It achieves state-of-the-art performance, with accuracies of 98.67% on FER2013, 99.52% on CK+, 99.3% on AffectNet, 96.3% on AFEW, and 98.45% on RAF-DB. An ablation study further validates the contribution of each model component, and comparisons with CNN-based and transformer-based approaches confirm the effectiveness of the model. These findings establish the proposed method as a significant advancement in FER, which offers a scalable and efficient solution for real-world applications.
引用
收藏
页码:56485 / 56508
页数:24
相关论文
共 50 条
  • [41] Transformer-Based Multimodal Emotional Perception for Dynamic Facial Expression Recognition in the Wild
    Zhang, Xiaoqin
    Li, Min
    Lin, Sheng
    Xu, Hang
    Xiao, Guobao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3192 - 3203
  • [42] EMOTION RECOGNITION BY A NOVEL TRIANGULAR FACIAL FEATURE EXTRACTION METHOD
    Huang, Kuan-Chieh
    Kuo, Yau-Hwang
    Horng, Mong-Fong
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2012, 8 (11): : 7729 - 7746
  • [43] Deep Learning Based Facial Emotion Recognition System
    Ozdemir, Mehmet Akif
    Elagoz, Berkay
    Soy, Aysegul Alaybeyoglu
    Akan, Aydin
    2020 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2020,
  • [44] Facial Emotion Recognition Based on CNN
    Liu, Shuang
    Li, Dahua
    Gao, Qiang
    Song, Yu
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 398 - 403
  • [45] Emotion Recognition With Multimodal Transformer Fusion Framework Based on Acoustic and Lexical Information
    Guo, Lili
    Wang, Longbiao
    Dang, Jianwu
    Fu, Yahui
    Liu, Jiaxing
    Ding, Shifei
    IEEE MULTIMEDIA, 2022, 29 (02) : 94 - 103
  • [46] Vision Transformer-Based Emotion Detection in HCI for Enhanced Interaction
    Soni, Jayesh
    Prabakar, Nagarajan
    Upadhyay, Himanshu
    INTELLIGENT HUMAN COMPUTER INTERACTION, IHCI 2023, PT I, 2024, 14531 : 76 - 86
  • [47] RM-Transformer: A Transformer-based Model for Mandarin Speech Recognition
    Lu, Xingyu
    Hu, Jianguo
    Li, Shenhao
    Ding, Yanyu
    2022 IEEE 2ND INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND ARTIFICIAL INTELLIGENCE (CCAI 2022), 2022, : 194 - 198
  • [48] A Transformer-Based Unsupervised Domain Adaptation Method for Skeleton Behavior Recognition
    Yan, Qiuyan
    Hu, Yan
    IEEE ACCESS, 2023, 11 : 51689 - 51700
  • [49] Real-time Emotion Recognition Novel Method for Geometrical Facial Features Extraction
    Loconsole, Claudio
    Miranda, Catarina Runa
    Augusto, Gustavo
    Frisoli, Antonio
    Orvalho, Veronica
    PROCEEDINGS OF THE 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS (VISAPP), VOL 1, 2014, : 378 - 385
  • [50] A Novel Approach of Emotion Recognition based on Selective Ensemble
    Zhu, Zhenguo
    He, Kun
    2008 3RD INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEM AND KNOWLEDGE ENGINEERING, VOLS 1 AND 2, 2008, : 695 - +