Faster Region Convolutional Neural Network (FRCNN) Based Facial Emotion Recognition

被引:0
作者
Angel, J. Sheril [1 ]
Andrushia, A. Diana [1 ]
Neebha, T. Mary [1 ]
Accouche, Oussama [2 ]
Saker, Louai [2 ]
Anand, N. [3 ]
机构
[1] Karunya Inst Technol & Sci, Dept Elect & Commun Engn, Coimbatore 641114, India
[2] Amer Univ Middle East, Coll Engn & Technol, Egaila 54200, Kuwait
[3] Karunya Inst Technol & Sci, Dept Civil Engn, Coimbatore 641114, India
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 79卷 / 02期
关键词
Facial emotions; FRCNN; deep learning; emotion recognition; face; CNN; EXPRESSION RECOGNITION; SYSTEM;
D O I
10.32604/cmc.2024.047326
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial emotion recognition (FER) has become a focal point of research due to its widespread applications, ranging from human-computer interaction to affective computing. While traditional FER techniques have relied on handcrafted features and classification models trained on image or video datasets, recent strides in artificial intelligence and deep learning (DL) have ushered in more sophisticated approaches. The research aims to develop a FER system using a Faster Region Convolutional Neural Network (FRCNN) and design a specialized FRCNN architecture tailored for facial emotion recognition, leveraging its ability to capture spatial hierarchies within localized regions of facial features. The proposed work enhances the accuracy and efficiency of facial emotion recognition. The proposed work comprises two major key components: Inception V3-based feature extraction and FRCNN-based emotion categorization. Extensive experimentation on Kaggle datasets validates the effectiveness of the proposed strategy, showcasing the FRCNN approach's resilience and accuracy in identifying and categorizing facial expressions. The model's overall performance metrics are compelling, with an accuracy of 98.4%, precision of 97.2%, and recall of 96.31%. This work introduces a perceptive deep learning-based FER method, contributing to the evolving landscape of emotion recognition technologies. The high accuracy and resilience demonstrated by the FRCNN approach underscore its potential for real-world applications. This research advances the field of FER and presents a compelling case for the practicality and efficacy of deep learning models in automating the understanding of facial emotions.
引用
收藏
页码:2427 / 2448
页数:22
相关论文
共 42 条
[1]   Emotion recognition support system: Where physicians and psychiatrists meet linguists and data engineers [J].
Adibi, Peyman ;
Kalani, Simindokht ;
Zahabi, Sayed Jalal ;
Asadi, Homa ;
Bakhtiar, Mohsen ;
Heidarpour, Mohammad Reza ;
Roohafza, Hamidreza ;
Shahoon, Hassan ;
Amouzadeh, Mohammad .
WORLD JOURNAL OF PSYCHIATRY, 2023, 13 (01) :1-14
[2]   Optimal Facial Feature Based Emotional Recognition Using Deep Learning Algorithm [J].
Arora, Tarun Kumar ;
Chaubey, Pavan Kumar ;
Raman, Manju Shree ;
Kumar, Bhupendra ;
Nagesh, Yagnam ;
Anjani, P. K. ;
Ahmed, Hamed M. S. ;
Hashmi, Arshad ;
Balamuralitharan, S. ;
Debtera, Baru .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
[3]   A deep learning model for classifying human facial expressions from infrared thermal images [J].
Bhattacharyya, Ankan ;
Chatterjee, Somnath ;
Sen, Shibaprasad ;
Sinitca, Aleksandr ;
Kaplun, Dmitrii ;
Sarkar, Ram .
SCIENTIFIC REPORTS, 2021, 11 (01)
[4]  
Cai J, 2018, CHIN CONTR CONF, P9608, DOI 10.23919/ChiCC.2018.8483567
[5]   Single Image Super-ResolutionUsing Deep CNN with Dense Skip Connections and Inception-ResNet [J].
Chen, Chao ;
Qi, Feng .
2018 NINTH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY IN MEDICINE AND EDUCATION (ITME 2018), 2018, :999-1003
[6]   Deep learning-based facial emotion recognition for human-computer interaction applications [J].
Chowdary, M. Kalpana ;
Nguyen, Tu N. ;
Hemanth, D. Jude .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (32) :23311-23328
[7]   Hierarchical scale convolutional neural network for facial expression recognition [J].
Fan, Xinqi ;
Jiang, Mingjie ;
Shahid, Ali Raza ;
Yan, Hong .
COGNITIVE NEURODYNAMICS, 2022, 16 (04) :847-858
[8]   Facial Expression Recognition via Deep Learning [J].
Fathallah, Abir ;
Abdi, Lotfi ;
Douik, Ali .
2017 IEEE/ACS 14TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2017, :745-750
[9]  
Hussain S. A., 2020, J PHYS C SER, V1432, DOI DOI 10.1088/1742-6596/1432/1/012087
[10]   Multi angle optimal pattern-based deep learning for automatic facial expression recognition [J].
Jain, Deepak Kumar ;
Zhang, Zhang ;
Huang, Kaiqi .
PATTERN RECOGNITION LETTERS, 2020, 139 :157-165