Facial expression recognition method based on deep convolutional neural network combined with improved LBP features

被引:2
作者
Fanzhi Kong
机构
[1] Communication University of Zhejiang,School of Electronics and Information
来源
Personal and Ubiquitous Computing | 2019年 / 23卷
关键词
Facial expression recognition; Machine learning; Deep convolutional neural network; Local binary mode (LBP);
D O I
暂无
中图分类号
学科分类号
摘要
Aiming at the disadvantages of the traditional machine-based facial expression recognition method that eliminates the feature of manual selection, a feature extraction method based on deep convolutional neural network to learn expression features is proposed. Since the deep convolutional neural network can directly use the original image as the input image, the image abstract feature interpretation is obtained at the fully connected layer of the image, which avoids the inherent error of image preprocessing and artificial selection features. Then, we reconstruct the traditional local binary pattern (LBP) feature operator for facial expression image and fuse the abstract facial expression features learned by the deep convolution neural network with the modified LBP facial expression texture features in the full connection layer. A new facial expression feature can be obtained, and the classification accuracy can be improved. In general, for the recognition of facial expression images, the proposed method based on the fusion LBP expression features and convolutional neural network expression features is used to obtain the best performance of 91.28% in the comparative experiment. An efficient extension of the expression feature texture expression channel is carried out. On the other hand, convolutional neural networks have incomparable advantages over other methods in abstract information representation of two-dimensional images.
引用
收藏
页码:531 / 539
页数:8
相关论文
共 53 条
[1]  
Zheng W(2014)Multi-view facial expression recognition based on group sparse reduced-rank regression IEEE Trans Affect Comput 5 71-85
[2]  
Zhao X(2015)Facial expression recognition via deep learning IETE Tech Rev 32 347-355
[3]  
Shi X(2016)Facial expression recognition based on a mlp neural network using constructive training algorithm[J] Multimed Tools Appl 75 709-731
[4]  
Zhang S(2016)Dynamic facial expression recognition with atlas construction and sparse representation IEEE Trans Image Process 25 1977-1992
[5]  
Boughrara H(2015)Unsupervised feature selection based on spectral regression from manifold learning for facial expression recognition Computer Vision Iet 9 655-662
[6]  
Chtourou M(2014)An occluded facial expression recognition method based on sparse representation Pattern Recogn Artif Intell 27 708-712
[7]  
Amar CB(2016)A deep neural network driven feature learning method for multi-view facial expression recognition IEEE Trans Multimedia 18 1-11
[8]  
Guo Y(2016)A modified sparse representation method for facial expression recognition Comput Intell Neurosci 2016 1-12
[9]  
Zhao G(2014)Linear subspaces for facial expression recognition Signal Process Image Commun 29 177-188
[10]  
Pietikainen M(2017)Automatic facial expression recognition system using deep network-based data fusion IEEE Trans Cybernetics 48 103-114