Introducing the Geneva Multimodal Expression Corpus for Experimental Research on Emotion Perception

被引:284
|
作者
Baenziger, Tanja [1 ]
Mortillaro, Marcello [1 ]
Scherer, Klaus R. [1 ]
机构
[1] Univ Geneva, Swiss Ctr Affect Sci, CH-1205 Geneva, Switzerland
关键词
emotion expression; emotion perception; expression corpora; stimulus validation; face; voice; multimodal communication; JAPANESE CULTURAL-DIFFERENCES; FACIAL EXPRESSIONS; VOCAL EXPRESSION; AFFECT PROGRAMS; RECOGNITION; VOICE; PERSONALITY; APPRAISAL; CUES; SET;
D O I
10.1037/a0025827
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Research on the perception of emotional expressions in faces and voices is exploding in psychology, the neurosciences. and affective computing. This article provides an overview of some of the major emotion expression (EE) corpora currently available for empirical research and introduces a new, dynamic, multimodal corpus of emotion expressions, the Geneva Multimodal Emotion Portrayals Core Set (GEMEP-CS). The design features of the corpus are outlined and justified, and detailed validation data for the core set selection are presented and discussed. Finally, an associated database with microcoded facial, vocal, and body action elements, as well as observer ratings, is introduced.
引用
收藏
页码:1161 / 1179
页数:19
相关论文
共 50 条
  • [1] In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion
    Scherer, Klaus R.
    Clark-Polner, Elizabeth
    Mortillaro, Marcello
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2011, 46 (06) : 401 - 435
  • [2] Using actor portrayals to systematically study multimodal emotion expression:: The GEMEP corpus
    Baenziger, Tanja
    Scherer, Klaus R.
    AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION, PROCEEDINGS, 2007, 4738 : 476 - 487
  • [3] The Variably Intense Vocalizations of Affect and Emotion (VIVAE) Corpus Prompts New Perspective on Nonspeech Perception
    Holz, Natalie
    Larrouy-Maestri, Pauline
    Poeppel, David
    EMOTION, 2022, 22 (01) : 213 - 225
  • [4] Modeling Development of Multimodal Emotion Perception Guided by Tactile Dominance and Perceptual Improvement
    Horii, Takato
    Nagai, Yukie
    Asada, Minoru
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2018, 10 (03) : 762 - 775
  • [5] Multimodal expression of emotion: Affect programs or componential appraisal patterns?
    Scherer, Klaus R.
    Ellgring, Heiner
    EMOTION, 2007, 7 (01) : 158 - 171
  • [6] Multimodal emotion perception after anterior temporal lobectomy (ATL)
    Milesi, Valerie
    Cekic, Sezen
    Peron, Julie
    Fruehholz, Sascha
    Cristinzio, Chiara
    Seeck, Margitta
    Grandjean, Didier
    FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 8
  • [7] Multimodal emotion perception in young and elderly patients with multiple sclerosis
    Montembeault, Maxime
    Brando, Estefania
    Charest, Kim
    Tremblay, Alexandra
    Roger, Elaine
    Duquette, Pierre
    Rouleau, Isabelle
    MULTIPLE SCLEROSIS AND RELATED DISORDERS, 2022, 58
  • [8] Introducing a Face Sort Paradigm to Evaluate Age Differences in Emotion Perception
    Hoemann, Katie
    Vicaria, Ishabel M.
    Gendron, Maria
    Stanley, Jennifer Tehan
    JOURNALS OF GERONTOLOGY SERIES B-PSYCHOLOGICAL SCIENCES AND SOCIAL SCIENCES, 2021, 76 (07): : 1272 - 1281
  • [9] A uniform human multimodal dataset for emotion perception and judgment
    Sun, Sai
    Cao, Runnan
    Rutishauser, Ueli
    Yu, Rongjun
    Wang, Shuo
    SCIENTIFIC DATA, 2023, 10 (01)
  • [10] Individual differences in social intelligence and perception of emotion expression of masked and unmasked faces
    Swain, Riley H.
    O'Hare, Aminda J.
    Brandley, Kamila
    Gardner, A. Tye
    COGNITIVE RESEARCH-PRINCIPLES AND IMPLICATIONS, 2022, 7 (01)