Enhanced Facial Emotion Recognition Using Vision Transformer Models

被引:0
作者
Fatima, N. Sabiyath [1 ]
Deepika, G. [2 ]
Anthonisamy, Arun [3 ]
Chitra, R. Jothi [4 ]
Muralidharan, J. [5 ]
Alagarsamy, Manjunathan [6 ]
Ramyasree, Kummari [7 ]
机构
[1] BS Abdur Rahman Crescent Inst Sci & Technol, Dept Comp Sci & Engn, Chennai 600048, Tamil Nadu, India
[2] MallaReddy Engn Coll Women, Dept Elect & Commun Engn, Secunderabad 500100, Telangana, India
[3] Panimalar Engn Coll, Dept Comp Sci & Business Syst, Chennai 600123, Tamil Nadu, India
[4] Velammal Inst Technol, Dept Elect & Commun Engn, Tiruvallur 601204, Tamil Nadu, India
[5] KPR Inst Engn & Technol, Dept Elect & Commun Engn, Coimbatore 641407, Tamil Nadu, India
[6] K Ramakrishnan Coll Technol, Dept Elect & Commun Engn, Trichy 621112, Tamil Nadu, India
[7] TR Univ Technol, Dept ECE, Patna, Bihar, India
关键词
Facial emotion recognition; Vision transformer; Self-attention; Machine learning; Artificial intelligence; Computer vision; Deep learning; Emotion detection;
D O I
10.1007/s42835-024-02118-w
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Automation of facial emotion recognition is an important branch of artificial intelligence and computer vision that has many potential applications in mental health diagnostics, human-computer interaction and security. The existing methods, however, usually have weaknesses in robustness, scalability and computational efficiency. This work proposes a self-attention-based Vision Transformer method that treats images as sequences of patches to capture global dependencies and spatial relations more effectively than other methods. The model is trained and evaluated using a large-scale dataset. On average, the model achieves an overall accuracy of 97%, with good precision, recall and F1 scores in most emotion categories. The model performed better and was more robust to variations in illumination and facial pose compared to other existing methods. This work takes a step forward in facial emotion recognition technology, providing a large-scale and efficient solution for real-world applications. Facial Emotion Recognition, a New Vision Transformer Based on Self-Attention for Machine Learning.
引用
收藏
页码:1143 / 1152
页数:10
相关论文
共 30 条
  • [1] Facial Emotion Recognition Using Transfer Learning in the Deep CNN
    Akhand, M. A. H.
    Roy, Shuvendu
    Siddique, Nazmul
    Kamal, Md Abdus Samad
    Shimamura, Tetsuya
    [J]. ELECTRONICS, 2021, 10 (09)
  • [2] Bayrakdar S., 2016, Sakarya Univ J Sci, V20, P383, DOI [10.16984/saufenbilder.92940., DOI 10.16984/SAUFENBILDER.92940]
  • [3] Bayrakdar S, 2017, An accelerated approach for facial expression analysis on video files, DOI [10.5505/pajes.2016.00908, DOI 10.5505/PAJES.2016.00908]
  • [4] Bayrakdar S, 2016, 2016 XITH INTERNATIONAL SCIENTIFIC AND TECHNICAL CONFERENCE COMPUTER SCIENCES AND INFORMATION TECHNOLOGIES (CSIT), P62, DOI 10.1109/STC-CSIT.2016.7589869
  • [5] Emotion Recognition Using Different Sensors, Emotion Models, Methods and Datasets: A Comprehensive Review
    Cai, Yujian
    Li, Xingguang
    Li, Jinsong
    [J]. SENSORS, 2023, 23 (05)
  • [6] A survey on facial emotion recognition techniques: A state-of-the-art literature review
    Canal, Felipe Zago
    Mueller, Tobias Rossi
    Matias, Jhennifer Cristine
    Scotton, Gustavo Gino
    de Sa, Antonio Reis
    Pozzebon, Eliane
    Sobieranski, Antonio Carlos
    [J]. INFORMATION SCIENCES, 2022, 582 : 593 - 617
  • [7] Survey on facial expressions recognition: databases, features and classification schemes
    Dujaili, Mohammed Jawad A., I
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 7457 - 7478
  • [8] Multi-task learning on the edge for effective gender, age, ethnicity and emotion recognition
    Foggia, Pasquale
    Greco, Antonio
    Saggese, Alessia
    Vento, Mario
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 118
  • [9] Revolutionizing vascular health through the temporal convolutional transformer for drug screening and model evolution
    Ganiya, Rajendra Kumar
    Veeraiah, D.
    Thatha, Venkata Nagaraju
    Rao, Katta Subba
    Rao, J. Nageswara
    Manjith, Ramaswamy
    Rajaram, A.
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [10] Adaptive fuzzy convolutional neural network for medical image classification
    Gupta, Shivani
    Patel, Nileshkumar
    Kumar, Ajay
    Jain, Neelesh Kumar
    Dass, Pranav
    Hegde, Rajalaxmi
    Rajaram, A.
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 9785 - 9801