The Role of Movement Kinematics in Facial Emotion Expression Production and Recognition

被引:33
|
作者
Sowden, Sophie [1 ]
Schuster, Bianca A. [1 ]
Keating, Connor T. [1 ]
Fraser, Dagmar S. [1 ]
Cook, Jennifer L. [1 ]
机构
[1] Univ Birmingham, Ctr Human Brain Hlth, Sch Psychol, 52 Pritchatts Rd, Birmingham B15 2SA, W Midlands, England
基金
英国医学研究理事会; 欧洲研究理事会;
关键词
facial emotion expression; emotion recognition; kinematics; speed; face tracking software; STATISTICAL POWER; POINT-LIGHT; PERCEPTION; AUTISM; FACE; DYNAMICS; SIGNALS; TOOL;
D O I
10.1037/emo0000835
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The kinematics of peoples' body movements provide useful cues about emotional states: for example, angry movements are typically fast and sad movements slow. Unlike the body movement literature, studies of facial expressions have focused on spatial, rather than kinematic, cues. This series of experiments demonstrates that speed comprises an important facial emotion expression cue. In Experiments 1a-1c we developed (N = 47) and validated (N = 27) an emotion-induction procedure, and recorded (N = 42) posed and spontaneous facial expressions of happy, angry, and sad emotional states. Our novel analysis pipeline quantified the speed of changes in distance between key facial landmarks. We observed that happy expressions were fastest, sad were slowest, and angry expressions were intermediate. In Experiment 2 (N = 67) we replicated our results for posed expressions and introduced a novel paradigm to index communicative emotional expressions. Across Experiments 1 and 2, we demonstrate differences between posed, spontaneous. and communicative expression contexts. Whereas mouth and eyebrow movements reliably distinguished emotions for posed and communicative expressions, only eyebrow movements were reliable for spontaneous expressions. In Experiments 3 and 4 we manipulated facial expression speed and demonstrated a quantifiable change in emotion recognition accuracy. That is, in a discovery (N = 29) and replication sample (N = 41), we showed that speeding up facial expressions promotes anger and happiness judgments. and slowing down expressions encourages sad judgments. This influence of kinematics on emotion recognition is dissociable from the influence of spatial cues. These studies demonstrate that the kinematics of facial movements provide added value, and an independent contribution to emotion recognition.
引用
收藏
页码:1041 / 1061
页数:21
相关论文
共 50 条
  • [1] Facial mimicry is not necessary to recognize emotion: Facial expression recognition by people with Moebius syndrome
    Bogart, Kathleen Rives
    Matsumoto, David
    SOCIAL NEUROSCIENCE, 2010, 5 (02) : 241 - 251
  • [2] Emotion Recognition by Integrating Eye Movement Analysis and Facial Expression Model
    Thong Van Huynh
    Yang, Hyung-Jeong
    Lee, Guee-Sang
    Kim, Soo-Hyung
    Na, In-Seop
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING (ICMLSC 2019), 2019, : 166 - 169
  • [3] Facial Expression Recognition with Identity and Emotion Joint Learning
    Li, Ming
    Xu, Hao
    Huang, Xingchang
    Song, Zhanmei
    Liu, Xiaolin
    Li, Xin
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (02) : 544 - 550
  • [4] Facial emotion recognition, theory of mind and the role of facial mimicry in depression
    Zwick, Julia C.
    Wolkenstein, Larissa
    JOURNAL OF AFFECTIVE DISORDERS, 2017, 210 : 90 - 99
  • [5] The role of facial movements in emotion recognition
    Krumhuber, Eva G.
    Skora, Lina I.
    Hill, Harold C. H.
    Lander, Karen
    NATURE REVIEWS PSYCHOLOGY, 2023, 2 (05): : 283 - 296
  • [6] Feasibility of Automated Training for Facial Emotion Expression and Recognition in Autism
    White, Susan W.
    Abbott, Lynn
    Wieckowski, Andrea Trubanova
    Capriola-Hall, Nicole N.
    Aly, Sherin
    Youssef, Amira
    BEHAVIOR THERAPY, 2018, 49 (06) : 881 - 888
  • [7] Voice, Body Cues and Facial Expression in Emotion Recognition of Spanish Children and Adolescents: The Validation of Bell-Lysaker Emotion Recognition Test
    Garcia-Guerrero, M. Acebo
    Pena, Javier
    Zubiaurre-Elorza, Leire
    Benitez, Danele
    Hernandez, Anais M.
    Oribe, Ainara
    Ojeda, Natalia
    SPANISH JOURNAL OF PSYCHOLOGY, 2022, 25
  • [8] THE ROLE OF AMBIENT TEMPERATURE IN FACIAL EMOTION RECOGNITION
    Vergara, Rodrigo C.
    Lopez, Vladimir
    Cosmelli, Diego
    PSYCHOPHYSIOLOGY, 2012, 49 : S92 - S92
  • [9] Facial emotion recognition in schizophrenia
    Chambon, Valerian
    Baudouin, Jean-Yves
    EVOLUTION PSYCHIATRIQUE, 2009, 74 (01): : 123 - 135
  • [10] Facial emotion recognition and eye movement behaviour in conduct disorder
    Martin-Key, N. A.
    Graf, E. W.
    Adams, W. J.
    Fairchild, G.
    JOURNAL OF CHILD PSYCHOLOGY AND PSYCHIATRY, 2018, 59 (03) : 247 - 257