Facial expression recognition using temporal relations among facial movements

被引:0
作者
Qiu, Yu [1 ]
Zhao, Jie-Yu [1 ]
Wang, Yan-Fang [1 ]
机构
[1] Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, 315211, Zhejiang
来源
Tien Tzu Hsueh Pao/Acta Electronica Sinica | 2016年 / 44卷 / 06期
关键词
Bayesian network; Facial expression recognition; Interval algebra; Sequential facial events;
D O I
10.3969/j.issn.0372-2112.2016.06.007
中图分类号
O144 [集合论]; O157 [组合数学(组合学)];
学科分类号
070104 ;
摘要
Spatial and temporal relations between different facial muscles are very important in the facial expression recognition process.However,these implicit relations have not been widely used due to the limitation of the current models.In order to make full use of spatial and temporal information,we model the facial expression as a complex activity consisting of different facial events.Furthermore,we introduce a special Bayesian network to capture the temporal relations among facial events and develop the corresponding algorithm for facial expression modeling and recognition.We only use the features based on tracking results and this method does not require the peak frames,which can improve the speed of training and recognition.Experimental results on the benchmark databases CK+ and MMI show that the proposed method is feasible in facial expression recognition and considerably improves the recognition accuracy. © 2016, Chinese Institute of Electronics. All right reserved.
引用
收藏
页码:1307 / 1313
页数:6
相关论文
共 24 条
[1]  
Pantic M., Rothkrantz L.J., Expert system for automatic analysis of facial expressions, Image and Vision Computing, 18, 11, pp. 881-905, (2000)
[2]  
Pantic M., Rothkrantz L.J., Facial action recognition for facial expression analysis from static face images, Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 34, 3, pp. 1449-1461, (2004)
[3]  
Buciu I., Kotropoulos C., Pitas I., ICA and Gabor representation for facial expression recognition, Proceedings of the International Conference on Image Processing, pp. 855-858, (2003)
[4]  
Xiaomin L., Yujin Z., Facial expression recognition based on Gabor histogram feature and MVBoost, Journal of Computer Research and Development, 44, 7, pp. 1089-1096, (2007)
[5]  
Ahonen T., Hadid A., Pietikainen M., Face description with local binary patterns: Application to face recognition, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28, 12, pp. 2037-2041, (2006)
[6]  
Cheon Y., Kim D., Natural facial expression recognition using differential-AAM and manifold learning, Pattern Recognition, 42, 7, pp. 1340-1350, (2009)
[7]  
Sanchez A., Ruiz J.V., Moreno A.B., Et al., Differential optical flow applied to automatic facial expression recognition, Neurocomputing, 74, 8, pp. 1272-1282, (2011)
[8]  
Koelstra S., Pantic M., Patras I., A dynamic texture-based approach to recognition of facial actions and their temporal models, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32, 11, pp. 1940-1954, (2010)
[9]  
Wu T., Bartlett M.S., Movellan J.R., Facial expression recognition using gabor motion energy filters, Proceedings of the Computer Vision and Pattern Recognition Workshops, pp. 42-47, (2010)
[10]  
Tong Y., Liao W., Ji Q., Facial action unit recognition by exploiting their dynamic and semantic relationships, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 29, 10, pp. 1683-1699, (2007)