HUMAN FACE AND FACIAL FEATURE TRACKING BY USING GEOMETRIC AND TEXTURE MODELS

This paper deals with the tracking system of the human face and facial feature based on the human face texture model combined with an algorithm for adaptation of the wireframe 3D model Candide-3 to the human face images. The human face texture model is represented by a set of eigenfaces which are obtained by means of the principal component analysis of the training set of completely preprocessed textures. The algorithm for adaptation of 3D model needs a reasonable starting approximation and an update matrix calculated from the training set by manual deviation of 3D model for single components of the parameter vector. The designed tracking system was tested on a real videosequence with various conditions and for adaptation of 3D model both global motion parameters and animation parameters of the mouth were used.