Predictive sampling of facial expression dynamics driven by a latent action space

被引:5
作者
Boccignone, Giuseppe [1 ]
Bodini, Matteo [1 ]
Cuculo, Vittorio [1 ]
Grossi, Giuliano [1 ]
机构
[1] Univ Milan, Dept Comp Sci, Milan, Italy
来源
2018 14TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS) | 2018年
关键词
facial expressions; Bayesian filtering; latent variable models; Gaussian Processes; TRACKING; MODEL; RECOGNITION; SIMULATION;
D O I
10.1109/SITIS.2018.00031
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a probabilistic generative model for tracking by prediction the dynamics of affective spacial expressions in videos. The model relies on Bayesian filter sampling of facial landmarks conditioned on motor action parameter dynamics; namely, trajectories shaped by an autoregressive Gaussian Process Latent Variable state-space. The analysis-by synthesis approach at the heart of the model allows for both inference and generation of affective expressions. Robustness of the method to occlusions and degradation of video quality has been assessed on a publicly available dataset.
引用
收藏
页码:143 / 150
页数:8
相关论文
共 44 条
[31]   3-D MOTION ESTIMATION IN MODEL-BASED FACIAL IMAGE-CODING [J].
LI, HB ;
ROIVAINEN, P ;
FORCHHEIMER, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1993, 15 (06) :545-555
[32]   The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English [J].
Livingstone, Steven R. ;
Russo, Frank A. .
PLOS ONE, 2018, 13 (05)
[33]   Visual learning by imitation with motor representations [J].
Lopes, M ;
Santos-Victor, J .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (03) :438-449
[34]  
Mayer C., 2008, 8 IEEE INT C AUTOMAT, P1
[35]  
MURRAY R. M., 1993, A Mathematical Introduction to Robotic Manipulation
[36]   Hierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises [J].
Orozco, Javier ;
Rudovic, Ognjen ;
Gonzalez, Jordi ;
Pantic, Maja .
IMAGE AND VISION COMPUTING, 2013, 31 (04) :322-340
[37]   Gaussian processes in machine learning [J].
Rasmussen, CE .
ADVANCED LECTURES ON MACHINE LEARNING, 2004, 3176 :63-71
[38]   Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition [J].
Sariyanidi, Evangelos ;
Gunes, Hatice ;
Cavallaro, Andrea .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (06) :1113-1133
[39]  
Tramacere A, 2016, J ANTHROPOL SCI, V94, P113, DOI [10.4436/jass.94037, 10.4436/JASS.94037]
[40]   Efficient generic face model fitting to images and videos [J].
Unzueta, Luis ;
Pimenta, Waldir ;
Goenetxea, Jon ;
Santos, Luis Paulo ;
Dornaika, Fadi .
IMAGE AND VISION COMPUTING, 2014, 32 (05) :321-334