Extended deep neural network for facial emotion recognition

被引:205
作者
Jain, Deepak Kumar [1 ]
Shamsolmoali, Pourya [2 ]
Sehdev, Paramjit [3 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Automat, Key Lab Intelligent Air Ground Cooperat Control U, Chongqing 400065, Peoples R China
[2] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai, Peoples R China
[3] Coppin State Univ, Dept Math & Comp Sci, Baltimore, MD USA
关键词
Facial emotion recognition; Deep neural network; Fully convolution network;
D O I
10.1016/j.patrec.2019.01.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Humans use facial expressions to show their emotional states. However, facial expression recognition has remained a challenging and interesting problem in computer vision. In this paper we present our approach which is the extension of our previous work for facial emotion recognition [1]. The aim of this work is to classify each image into one of six facial emotion classes. The proposed model is based on single Deep Convolutional Neural Networks (DNNs), which contain convolution layers and deep residual blocks. In the proposed model, firstly the image label to all faces has been set for the training. Secondly, the images go through proposed DNN model. This model trained on two datasets Extended Cohn-Kanade (CK+) and Japanese Female Facial Expression (JAFFE) Dataset. The overall results show that, the proposed DNN model can outperform the recent state-of-the-art approaches for emotion recognition. Even the proposed model has accuracy improvement in comparison with our previous model. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:69 / 74
页数:6
相关论文
共 7 条
[1]  
[Anonymous], ECCV WORKSH COMP VIS
[2]  
[Anonymous], 2014, 52 ANN M ASS COMP LI
[3]  
[Anonymous], INT C MULT INT 13 IC
[4]   Hybrid deep neural networks for face emotion recognition [J].
Jain, Neha ;
Kumar, Shishir ;
Kumar, Amit ;
Shamsolmoali, Pourya ;
Zareapoor, Masoumeh .
PATTERN RECOGNITION LETTERS, 2018, 115 :101-106
[5]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[6]   Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order [J].
Lopes, Andre Teixeira ;
de Aguiar, Edilson ;
De Souza, Alberto F. ;
Oliveira-Santos, Thiago .
PATTERN RECOGNITION, 2017, 61 :610-628
[7]   Facial expression recognition based on Local Binary Patterns: A comprehensive study [J].
Shan, Caifeng ;
Gong, Shaogang ;
McOwan, Peter W. .
IMAGE AND VISION COMPUTING, 2009, 27 (06) :803-816