Facial expression recognition and analysis: A comparison study of feature descriptors

被引:0
作者
Liew, Chun Fui [1 ]
Yairi, Takehisa [1 ]
机构
[1] University of Tokyo, Bunkyo, Tokyo
基金
日本学术振兴会;
关键词
Binary Robust Independent Elementary Features; Facial expression recognition; Gabor filter; Haar filter; Histogram of oriented gradients; Local binary patterns;
D O I
10.2197/ipsjtcva.7.104
中图分类号
学科分类号
摘要
Facial expression recognition (FER) is a crucial technology and a challenging task for human-computer interaction. Previous methods have been using different feature descriptors for FER and there is a lack of comparison study. In this paper, we aim to identify the best features descriptor for FER by empirically evaluating five feature descriptors, namely Gabor, Haar, Local Binary Pattern (LBP), Histogram of Oriented Gradients (HOG), and Binary Robust Independent Elementary Features (BRIEF) descriptors. We examine each feature descriptor by considering six classification methods, such as k-Nearest Neighbors (k-NN), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), and Adaptive Boosting (AdaBoost) with four unique facial expression datasets. In addition to test accuracies, we present confusion matrices of FER. We also analyze the effect of combined features and image resolutions on FER performance. Our study indicates that HOG descriptor works the best for FER when image resolution of a detected face is higher than 48×48 pixels. © 2015 Information Processing Society of Japan.
引用
收藏
页码:104 / 120
页数:16
相关论文
共 67 条
  • [21] Bartlett M., Littlewort G., Frank M., Lainscsek C., Fasel I., Movellan J., Automatic recognition of facial actions in spontaneous expressions, Journal of Multimedia, 1, 6, pp. 22-35, (2006)
  • [22] Bartlett M., Littlewort G., Lainscsek C., Fasel I., Frank M., Movellan J., Fully automatic facial action recognition in spontaneous behavior, Proc. 7th International Conference on Automatic Face and Gesture Recognition, pp. 223-228, (2006)
  • [23] Littlewort G., Bartlett M., Fasel I., Susskind J., Movellan J., Dynamics of facial expression extracted automatically from video, Journal of Image and Vision Computing, 24, 6, pp. 615-625, (2006)
  • [24] Lee C., Shih C., Gabor feature selection for facial expression recognition, Proc. International Conference on Signals and Electronic Systems, pp. 139-142, (2010)
  • [25] Xu C., Dong C., Feng Z., Cao T., Facial expression pervasive analysis based on haar-like features and SVM, Proc. The International Conference on E-business Technology and Strategy, pp. 521-529, (2012)
  • [26] Jung S., Kim D., An K., Chung M., Efficient rectangle feature extraction for real-time facial expression recognition based on AdaBoost, Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1941-1946, (2005)
  • [27] Nagi G., Rahmat R., Khalid F., Taufik M., Region-based facial expression recognition in still images, Journal of Information Processing Systems, 9, 1, pp. 173-188, (2013)
  • [28] Dahmane M., Meunier J., Emotion recognition using dynamic grid-based HOG features, Proc. IEEE International Conference on Automatic Face and Gesture Recognition Workshops, pp. 884-888, (2011)
  • [29] Orrite C., Ganan A., Rogez G., HOG-based decision tree for facial expression classification, Proc. 4th Iberian Conference on Pattern Recognition and Image Analysis, pp. 176-183, (2009)
  • [30] Chen S., Tian Y., Liu Q., Metaxas D., Recognizing expressions from face and body gesture by temporal normalized motion and appearance features, Journal of Image and Vision Computing, 31, 2, pp. 175-185, (2013)