A text-based synthetic face with emotions*

The human face in particular serves not only communicative functions, but it is also the primary channel to express emotion. We develop a prototype of a synthetic 3D face that shows emotion associated to text-based speech in an automated way. As a first step we studied how many and what kind of emotional expressions produced by humans during conversations. The next, we studied the correlation between the displayed facial expressions and text. Based on these results. we developed a set of rules that describes dependencies between text and emotions by the employment of ontology. For this purpose, a 2D affective lexicon database has been built using WordNet database and the specific facial expressions are stored in a nonverbal dictionary. The results described in this paper enable affective-based multimodal fission.