Facial Expression Recognition Based on Deep Binary Convolutional Network

被引：0
|
作者：
Zhou L. [1 ,2 ,3 ]
Liu J. [1 ,2 ]
Li W. [2 ]
Mi J. [2 ]
Lei B. [3 ]
机构：
[1] College of Software, Chongqing University of Posts and Telecommunications, Chongqing
[2] Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing
[3] Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering, China Three Gorges University, Yichang
来源：
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2022年 / 34卷 / 03期
关键词：
Attention mechanism; Binary convolutional network; Facial expression recognition; Local binary pattern;
D O I：
10.3724/SP.J.1089.2022.18920
中图分类号：
学科分类号：
摘要：
Facial expression recognition (FER) is a challenging task because of the large number of parameters, low speed and insufficient feature representation of the expression region. In order to address the above-mentioned challenges, a deep binary convolutional network for FER is proposed. Firstly, a lightweight convolution network (BRNet) with parallel operation of binary convolution and traditional convolution is designed to reduce the complexity of network and improve the speed of recognition. Secondly, a dynamic radius strategy is constructed to extract binary features and form the attention weight of expression region so that the local features and global features can be fused effectively. Finally, the cross-entropy and L2 loss are designed for quick and accurate expression classification. Experiments show that the average accuracy of the proposed method is 99.25% and 93.85% on CK+ and Oulu-CASIA respectively, which are higher than the other similar lightweight convolutional networks. The parameters and computation cost of network are 5.0×105 bytes and 2.1×106 bytes. In contrast, the computation cost of EfficientFace is about 77 times than proposed method. As a result, the effectiveness and lightness of proposed method have been proved. © 2022, Beijing China Science Journal Publishing Co. Ltd. All right reserved.
引用
收藏
页码：425 / 436
页数：11
相关论文
共 43 条
  • [1] Zhang Wenping, Jia Kai, Wang Hongyu, Et al., Application of improved island loss in facial expression recognition, Journal of Computer-Aided Design & Computer Graphics, 32, 12, pp. 1910-1917, (2020)
  • [2] Zhao X Y, Liang X D, Liu L Q, Et al., Peak-piloted deep network for facial expression recognition, Proceedings of the European Conference on Computer Vision, pp. 425-442, (2016)
  • [3] Cai J, Meng Z B, Khan A S, Et al., Island loss for learning discriminative features in facial expression recognition, Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 302-309, (2018)
  • [4] Ding H, Zhou S K, Chellappa R., FaceNet2ExpNet: regularizing a deep face recognition net for expression recognition, Proceedings of the 12th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 118-126, (2017)
  • [5] Xie S Y, Hu H F, Wu Y B., Deep multi-path convolutional neural network joint with salient region attention for facial expression recognition, Pattern Recognition, 92, pp. 177-191, (2019)
  • [6] Simonyan K, Zisserman A., Very deep convolutional networks for large-scale image recognition
  • [7] Hubara I, Courbarlaux M, Soudry D, Et al., Binarized neural networks, Proceedings of the 30th International Conference on Neural Information Processing Systems, pp. 4114-4122, (2016)
  • [8] Ding Wenyue, Liu Chunlei, Li Yue, Et al., Binary convolutional neural network: review, Acta Aeronautica ET Astronautica Sinica, 42, 4, (2021)
  • [9] Kumawat S, Verma M, Raman S., LBVCNN: local binary volume convolutional neural network for facial expression recognition from image sequences, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 207-216, (2019)
  • [10] He K M, Zhang X, Ren S, Et al., Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778, (2016)
12345