A Novel Transformer-Based Approach for Adult's Facial Emotion Recognition

被引:0
|
作者
Nawaz, Uzma [1 ]
Saeed, Zubair [2 ,3 ]
Atif, Kamran [4 ]
机构
[1] Natl Univ Sci & Technol, Coll Elect & Mech Engn, Knowledge & Data Sci Res Ctr, Dept Comp & Software Engn, Islamabad 44000, Pakistan
[2] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX 77840 USA
[3] Texas A&M Univ Qatar, Dept Elect & Comp Engn, Doha, Qatar
[4] Deakin Univ, Dept Civil Engn, Melbourne, Vic 3125, Australia
来源
IEEE ACCESS | 2025年 / 13卷
关键词
Emotion recognition; Transformers; Face recognition; Accuracy; Brain modeling; Real-time systems; Adaptation models; Lighting; Human computer interaction; Facial features; Facial emotion recognition; transformers; deep learning; FER2013; CK plus; AffectNet; AFEW; RAF-DB; emotion recognition; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3555510
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Adult facial expression recognition (FER) is essential for human-computer interaction, mental health assessment, and social robotics applications because it improves user experiences and emotional well-being. This study presents a novel attention mechanism-based transformer approach designed to capture detailed patterns in facial features and dynamically focus on the most relevant regions for enhanced accuracy. Unlike conventional deep learning approaches, our method integrates an adaptive attention mechanism and dynamic token pruning, which optimizes computational efficiency while maintaining high accuracy. The model is evaluated on five widely used datasets: FER2013, CK+, AffectNet, RAF-DB, and AFEW. It achieves state-of-the-art performance, with accuracies of 98.67% on FER2013, 99.52% on CK+, 99.3% on AffectNet, 96.3% on AFEW, and 98.45% on RAF-DB. An ablation study further validates the contribution of each model component, and comparisons with CNN-based and transformer-based approaches confirm the effectiveness of the model. These findings establish the proposed method as a significant advancement in FER, which offers a scalable and efficient solution for real-world applications.
引用
收藏
页码:56485 / 56508
页数:24
相关论文
共 50 条
  • [21] A transformer-based approach for Arabic offline handwritten text recognition
    Momeni, Saleh
    Babaali, Bagher
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (04) : 3053 - 3062
  • [22] A transformer-based approach for Arabic offline handwritten text recognition
    Saleh Momeni
    Bagher BabaAli
    Signal, Image and Video Processing, 2024, 18 : 3053 - 3062
  • [23] EEG-based Emotion Recognition via Transformer Neural Architecture Search
    Li, Chang
    Zhang, Zhongzhen
    Zhang, Xiaodong
    Huang, Guoning
    Liu, Yu
    Chen, Xun
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (04) : 6016 - 6025
  • [24] A novel PSO-ViT approach for facial emotion recognition
    Fliss, Imtiez
    Zemzem, Wiem
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2024, 11 (07):
  • [25] A novel facial emotion recognition method for stress inference of facial nerve paralysis patients
    Xu, Cuiting
    Yan, Chunchuan
    Jiang, Mingzhe
    Alenezi, Fayadh
    Alhudhaif, Adi
    Alnaim, Norah
    Polat, Kemal
    Wu, Wanqing
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 197
  • [26] Facial Emotion Recognition System Based on PCA and Gradient Features
    Arora, Malika
    Kumar, Munish
    Garg, Naresh Kumar
    NATIONAL ACADEMY SCIENCE LETTERS-INDIA, 2018, 41 (06): : 365 - 368
  • [27] Efficient-SwishNet Based System for Facial Emotion Recognition
    Dar, Tarim
    Javed, Ali
    Bourouis, Sami
    Hussein, Hany S.
    Alshazly, Hammam
    IEEE ACCESS, 2022, 10 : 71311 - 71328
  • [28] Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG
    Pan, Jiahui
    Fang, Weijie
    Zhang, Zhihang
    Chen, Bingzhi
    Zhang, Zheng
    Wang, Shuihua
    IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY, 2024, 5 : 396 - 403
  • [29] Improved facial emotion recognition model based on a novel deep convolutional structure
    Elsheikh, Reham A.
    Mohamed, M. A.
    Abou-Taleb, Ahmed Mohamed
    Ata, Mohamed Maher
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [30] A Fuzzy Approach for Facial Emotion Recognition
    Farahani, Fatemeh Shahrabi
    Sheikhan, Mansour
    Farrokhi, Ali
    2013 13TH IRANIAN CONFERENCE ON FUZZY SYSTEMS (IFSC), 2013,