Identifying emotions from facial expressions using a deep convolutional neural network-based approach

被引:43
作者
Meena, Gaurav [1 ]
Mohbey, Krishna Kumar [1 ]
Indian, Ajay [1 ]
Khan, Mohammad Zubair [2 ]
Kumar, Sunil [3 ]
机构
[1] Cent Univ Rajasthan, Dept Comp Sci, Ajmer 305817, India
[2] Taibah Univ, Dept Comp Sci, Fac Engn, Yanbu, Saudi Arabia
[3] Vellore Inst Technol, Sch Comp Sci & Engn, Vellore, India
关键词
Deep learning; Facial sentiment analysis; Convolutional neural networks; SENTIMENT ANALYSIS; STATE;
D O I
10.1007/s11042-023-16174-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment identification on facial expression is an interesting study domain with applications in various disciplines, including security, health, and human-machine interfaces. The main goal of sentiment analysis is to decide an individual's perspective on a topic or the document's overall contextual polarity. In nonverbal communication, sentiment analysis plays a vital role in an individual's feelings, reflecting on the faces. Researchers in this area are interested in improving models and methods and extracting various characteristics to provide a better computer prediction of sentiments. Sentiment polarities are mainly classified as positive, negative, and neutral. Many sentiment analysis approaches exist, but deep learning architectures can handle extensive data and provide better performances. We presented a solution based on the CNN (Convolutional Neural Network) model for handling this problem. This work uses the extended Cohn Kanade (CK+) and FER-2013 datasets for facial expression recognition study. Several existing architectures are used to evaluate the efficiency of the proposed model. Extensive experiments are carried out on both CK+ and FER-2013 data sets, and our framework outperforms state-of-the-art techniques. According to obtained results, the CNN3 model gives 79% and 95% accuracy for FER-2013 and CK+ datasets, respectively.
引用
收藏
页码:15711 / 15732
页数:22
相关论文
共 56 条
[1]   Using CNN for facial expression recognition: a study of the effects of kernel size and number of filters on accuracy [J].
Agrawal, Abhinav ;
Mittal, Namita .
VISUAL COMPUTER, 2020, 36 (02) :405-412
[2]  
Ain QT, 2017, INT J ADV COMPUT SC, V8, P424, DOI 10.14569/ijacsa.2017.080657
[3]   Facial Emotion Recognition in Verbal Communication Based on Deep Learning [J].
Alsharekh, Mohammed F. .
SENSORS, 2022, 22 (16)
[4]  
Appasaheb Borgalli Rohan, 2022, Journal of Physics: Conference Series, V2236, DOI [10.1088/1742-6596/2236/1/012004, 10.1088/1742-6596/2236/1/012004]
[5]  
Babajee P, 2020, 2020 ZOOMING INNOVATION IN CONSUMER TECHNOLOGIES CONFERENCE (ZINC), P36, DOI [10.1109/zinc50678.2020.9161445, 10.1109/ZINC50678.2020.9161445]
[6]   Real-time facial expression recognition using smoothed deep neural network ensemble [J].
Benamara, Nadir Kamel ;
Val-Calvo, Mikel ;
Alvarez-Sanchez, Jose Ramon ;
Diaz-Morcillo, Alejandro ;
Ferrandez-Vicente, Jose Manuel ;
Fernandez-Jover, Eduardo ;
Stambouli, Tarik Boudghene .
INTEGRATED COMPUTER-AIDED ENGINEERING, 2021, 28 (01) :97-111
[7]  
Bengio Yoshua., 2017, DEEP LEARNING, V1
[8]   Feast: face and emotion analysis system for smart tablets [J].
Benmohamed, Abderrahim ;
Neji, Mohamed ;
Ramdani, Messaoud ;
Wali, Ali ;
Alimi, Adel M. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (21) :9297-9322
[9]   Convolutional Neural Networks for Multimedia Sentiment Analysis [J].
Cai, Guoyong ;
Xia, Binbin .
NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2015, 2015, 9362 :159-167
[10]   From pixels to sentiment: Fine-tuning CNNs for visual sentiment prediction [J].
Campos, Victor ;
Jou, Brendan ;
Giro-i-Nieto, Xavier .
IMAGE AND VISION COMPUTING, 2017, 65 :15-22