The Role of Movement Kinematics in Facial Emotion Expression Production and Recognition

被引:33
|
作者
Sowden, Sophie [1 ]
Schuster, Bianca A. [1 ]
Keating, Connor T. [1 ]
Fraser, Dagmar S. [1 ]
Cook, Jennifer L. [1 ]
机构
[1] Univ Birmingham, Ctr Human Brain Hlth, Sch Psychol, 52 Pritchatts Rd, Birmingham B15 2SA, W Midlands, England
基金
英国医学研究理事会; 欧洲研究理事会;
关键词
facial emotion expression; emotion recognition; kinematics; speed; face tracking software; STATISTICAL POWER; POINT-LIGHT; PERCEPTION; AUTISM; FACE; DYNAMICS; SIGNALS; TOOL;
D O I
10.1037/emo0000835
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The kinematics of peoples' body movements provide useful cues about emotional states: for example, angry movements are typically fast and sad movements slow. Unlike the body movement literature, studies of facial expressions have focused on spatial, rather than kinematic, cues. This series of experiments demonstrates that speed comprises an important facial emotion expression cue. In Experiments 1a-1c we developed (N = 47) and validated (N = 27) an emotion-induction procedure, and recorded (N = 42) posed and spontaneous facial expressions of happy, angry, and sad emotional states. Our novel analysis pipeline quantified the speed of changes in distance between key facial landmarks. We observed that happy expressions were fastest, sad were slowest, and angry expressions were intermediate. In Experiment 2 (N = 67) we replicated our results for posed expressions and introduced a novel paradigm to index communicative emotional expressions. Across Experiments 1 and 2, we demonstrate differences between posed, spontaneous. and communicative expression contexts. Whereas mouth and eyebrow movements reliably distinguished emotions for posed and communicative expressions, only eyebrow movements were reliable for spontaneous expressions. In Experiments 3 and 4 we manipulated facial expression speed and demonstrated a quantifiable change in emotion recognition accuracy. That is, in a discovery (N = 29) and replication sample (N = 41), we showed that speeding up facial expressions promotes anger and happiness judgments. and slowing down expressions encourages sad judgments. This influence of kinematics on emotion recognition is dissociable from the influence of spatial cues. These studies demonstrate that the kinematics of facial movements provide added value, and an independent contribution to emotion recognition.
引用
收藏
页码:1041 / 1061
页数:21
相关论文
共 50 条
  • [31] EMOTION RECOGNITION BY FACIAL EXPRESSION IN CHEMICAL ADDICTION: PILOT STUDY
    Fediukovich, Ekaterina I.
    Trusova, Anna V.
    KONSULTATIVNAYA PSIKHOLOGIYA I PSIKHOTERAPIYA-COUNSELING PSYCHOLOGY AND PSYCHOTHERAPY, 2023, 31 (02): : 152 - 170
  • [32] Facial Expression Based Emotion Recognition Using Neural Networks
    Yagis, Ekin
    Unel, Mustafa
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 : 210 - 217
  • [33] Emotion Recognition Using Facial Expression Images for a Robotic Companion
    Ruiz-Garcia, Ariel
    Elshaw, Mark
    Altahhan, Abdulrahman
    Palade, Vasile
    ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EANN 2016, 2016, 629 : 79 - 93
  • [34] Emotion Recognition Research based on Integration of Facial Expression and Voice
    Xu, Fen
    Wang, Zhe
    2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [35] Emotion Recognition From Body Movement
    Ahmed, Ferdous
    Bari, A. S. M. Hossain
    Gavrilova, Marina L.
    IEEE ACCESS, 2020, 8 : 11761 - 11781
  • [36] Task Dependency When Evaluating Association Between Facial Emotion Recognition and Facial Emotion Expression in Children with ASD
    Wieckowski, Andrea Trubanova
    Swain, Deanna M.
    Abbott, A. Lynn
    White, Susan W.
    JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2019, 49 (02) : 460 - 467
  • [37] Task Dependency When Evaluating Association Between Facial Emotion Recognition and Facial Emotion Expression in Children with ASD
    Andrea Trubanova Wieckowski
    Deanna M. Swain
    A. Lynn Abbott
    Susan W. White
    Journal of Autism and Developmental Disorders, 2019, 49 : 460 - 467
  • [38] Exploring the role of face processing in facial emotion recognition in schizophrenia
    Rocca, Paola
    Castagna, Filomena
    Mongini, Tullia
    Montemagni, Cristiana
    Rasetti, Roberta
    Rocca, Giuseppe
    Bogetto, Filippo
    ACTA NEUROPSYCHIATRICA, 2009, 21 (06): : 292 - 300
  • [39] The Indonesian Mixed Emotion Dataset (IMED): A Facial Expression Dataset for Mixed Emotion Recognition
    Liliana, Dewi Yanti
    Basaruddin, T.
    Oriza, Imelda Ika Dian
    AIVR 2018: 2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY, 2018, : 52 - 56
  • [40] The elusive link between eye-movement patterns and facial expression recognition
    Yitzhak, Neta
    Pertzov, Yoni
    Aviezer, Hillel
    SOCIAL AND PERSONALITY PSYCHOLOGY COMPASS, 2021, 15 (07)