Multi-scale depthwise separable convolution facial expression recognition embedded in attention mechanism

被引:0
作者
Song Y. [1 ]
Gao S. [1 ]
Zeng H. [1 ]
Xiong G. [1 ]
机构
[1] School of Electronics and Information, Xi’an Polytechnic University, Xi’an
来源
Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics | 2022年 / 48卷 / 12期
关键词
attention mechanism; depthwise separable convolution; expression recognition; multi-scale feature extraction; residual network;
D O I
10.13700/j.bh.1001-5965.2021.0114
中图分类号
学科分类号
摘要
For facial expression recognition, traditional machine learning method features extraction is relatively complex, shallow convolutional neural network recognition rate is not high, and deep convolutional network is easy to cause gradient explosion or dispersion problems. This paper constructs the multi-scale deep separable expression recognition network with residual network which embedded in attention mechanism. Through superposition of multi-layer and multi-scale depth separable residual elements, facial expression feature extraction of different scales is achieved; in the meanwhile, CBAM attention mechanism was used to screen the expression features for the purpose of improving the expression of the weight of the expression features and weakening the noise impact of training data. The algorithm network model in this paper achieves accuracy of 73.89% and 97.47% in Fer-2103 and CK + expression data sets respectively, which indicates that this network has strong generalization. © 2022 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.
引用
收藏
页码:2381 / 2387
页数:6
相关论文
共 20 条
[1]  
SHAN C, GONG S, MCOWAN P W., Facial expression recognition based on local binary patterns: A comprehensive study [J], Image and Vision Computing, 27, 6, pp. 803-816, (2009)
[2]  
LUO Y, ZHANG T, ZHANG Y., A novel fusion method of PCA and LDP for facial expression feature extraction [ J], Optik, 127, 2, pp. 718-721, (2016)
[3]  
LIU S S, TIAN Y T, WAN C., Facial expression recognition method based on Gabor multiorien-tation features fusion and block histogram [ J], Acta Automatica Sinica, 37, 12, pp. 1455-1463, (2011)
[4]  
KUMAR V D A, KUMAR V D A, MALATHI S, Et al., Facial recognition system for suspect identification using a surveillance camera[ J ], Pattern Recognition and Image Analysis, 28, 3, pp. 410-420, (2018)
[5]  
ZHOU J, ZHANG S, MEI H, Et al., A method of facial expression recognition based on Gabor and NMF[J], Pattern Recognition and Image Analysis, 26, 1, pp. 119-124, (2016)
[6]  
HSIEH C C, HSIH M H, JIANG M K, Et al., Effective semantic features for facial expressions recognition using SVM[J], Multimedia Tools and Applications, 75, 11, pp. 6663-6682, (2016)
[7]  
SUN K, KANG H, PARK H H., Tagging and classifying facial images in cloud environments based on KNN using MapReduce [J], Optik, 126, 21, pp. 3227-3233, (2015)
[8]  
LI Y, LIN X Z, JIANG M Y., Facial expression recognition based on cross-connected LeNet-5 network, Acta Automatica Sinica, 44, 1, pp. 176-182, (2018)
[9]  
MOLLAHOSSEINI A, CHAN D, MAHOOR M H., Going deeper in facial expression recognition using deep neural networks[C], 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1-10, (2016)
[10]  
JUNG H, LEE S, YIM J, Et al., Joint fine-tuning in deep neural networks for facial expression recognition[ C], Proceedings of the IEEE International Conference on Computer Vision, pp. 2983-2991, (2015)