A Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing

被引:84
作者
Zhang, Hongli [1 ]
Jolfaei, Alireza [2 ]
Alazab, Mamoun [3 ]
机构
[1] Inner Mongolia Normal Univ, Dept Educ Technol, Hohhot 010022, Peoples R China
[2] Macquarie Univ, Dept Comp, Sydney, NSW 2109, Australia
[3] Charles Darwin Univ, Darwin, NT 0810, Australia
关键词
Feature extraction; Face recognition; Image edge detection; Face; Eigenvalues and eigenfunctions; Emotion recognition; Face expression recognition; convolutional neural network; edge computing; deep learning; image edge detection; FACIAL EXPRESSION RECOGNITION; MODELS; REPRESENTATION; FEATURES;
D O I
10.1109/ACCESS.2019.2949741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To avoid the complex process of explicit feature extraction in traditional facial expression recognition, a face expression recognition method based on a convolutional neural network (CNN) and an image edge detection is proposed. Firstly, the facial expression image is normalized, and the edge of each layer of the image is extracted in the convolution process. The extracted edge information is superimposed on each feature image to preserve the edge structure information of the texture image. Then, the dimensionality reduction of the extracted implicit features is processed by the maximum pooling method. Finally, the expression of the test sample image is classified and recognized by using a Softmax classifier. To verify the robustness of this method for facial expression recognition under a complex background, a simulation experiment is designed by scientifically mixing the Fer-2013 facial expression database with the LFW data set. The experimental results show that the proposed algorithm can achieve an average recognition rate of 88.56 with fewer iterations, and the training speed on the training set is about 1.5 times faster than that on the contrast algorithm.
引用
收藏
页码:159081 / 159089
页数:9
相关论文
共 29 条
[1]  
[Anonymous], 2017, OPT MEM NEURAL NETWO, DOI [DOI 10.3103/S1060992X17020102, 10.3103/S1060992X17020102]
[2]   Semantic-Emotion Neural Network for Emotion Recognition From Text [J].
Batbaatar, Erdenebileg ;
Li, Meijing ;
Ryu, Keun Ho .
IEEE ACCESS, 2019, 7 :111866-111878
[3]  
Cai J, 2018, CHIN CONTR CONF, P9608, DOI 10.23919/ChiCC.2018.8483567
[4]   Guest Editorial: The Computational Face [J].
Escalera, Sergio ;
Baro, Xavier ;
Guyon, Isabelle ;
Escalante, Hugo Jair ;
Tzimiropoulos, Georgios ;
Valstar, Michel ;
Pantic, Maja ;
Cohn, Jeffrey ;
Kanade, Takeo .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) :2541-2545
[5]   Study on Human Welder Behavior by Measuring Local Flow Pattern of Weld Pool and Torch Posture [J].
Fan, Ding ;
Dun, Xiaochun ;
Zhang, Gang ;
Shi, Yu .
TRANSACTIONS ON INTELLIGENT WELDING MANUFACTURING, VOL I, NO. 1 2017, 2018, 1 (01) :27-35
[6]   Facial expression recognition based on local region specific features and support vector machines [J].
Ghimire, Deepak ;
Jeong, Sunghwan ;
Lee, Joonwhoan ;
Park, San Hyun .
MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (06) :7803-7821
[7]   Joint facial expression recognition and intensity estimation based on weighted votes of image sequences [J].
Kamarol, Siti Khairuni Amalina ;
Jaward, Mohamed Hisham ;
Kalviainen, Heikki ;
Parkkinen, Jussi ;
Parthiban, Rajendran .
PATTERN RECOGNITION LETTERS, 2017, 92 :25-32
[8]  
Kumar N, 2017, J STAT MANAG SYST, V20, P693, DOI 10.1080/09720510.2017.1395189
[9]   Intra-Class Variation Reduction Using Training Expression Images for Sparse Representation Based Facial Expression Recognition [J].
Lee, Seung Ho ;
Plataniotis, Konstantinos N. ;
Ro, Yong Man .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2014, 5 (03) :340-351
[10]   Facial Expression Recognition with Faster R-CNN [J].
Li, Jiaxing ;
Zhang, Dexiang ;
Zhang, Jingjing ;
Zhang, Jun ;
Li, Teng ;
Xia, Yi ;
Yan, Qing ;
Xun, Lina .
ADVANCES IN INFORMATION AND COMMUNICATION TECHNOLOGY, 2017, 107 :135-140