The Role of Movement Kinematics in Facial Emotion Expression Production and Recognition

被引:33
|
作者
Sowden, Sophie [1 ]
Schuster, Bianca A. [1 ]
Keating, Connor T. [1 ]
Fraser, Dagmar S. [1 ]
Cook, Jennifer L. [1 ]
机构
[1] Univ Birmingham, Ctr Human Brain Hlth, Sch Psychol, 52 Pritchatts Rd, Birmingham B15 2SA, W Midlands, England
基金
英国医学研究理事会; 欧洲研究理事会;
关键词
facial emotion expression; emotion recognition; kinematics; speed; face tracking software; STATISTICAL POWER; POINT-LIGHT; PERCEPTION; AUTISM; FACE; DYNAMICS; SIGNALS; TOOL;
D O I
10.1037/emo0000835
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The kinematics of peoples' body movements provide useful cues about emotional states: for example, angry movements are typically fast and sad movements slow. Unlike the body movement literature, studies of facial expressions have focused on spatial, rather than kinematic, cues. This series of experiments demonstrates that speed comprises an important facial emotion expression cue. In Experiments 1a-1c we developed (N = 47) and validated (N = 27) an emotion-induction procedure, and recorded (N = 42) posed and spontaneous facial expressions of happy, angry, and sad emotional states. Our novel analysis pipeline quantified the speed of changes in distance between key facial landmarks. We observed that happy expressions were fastest, sad were slowest, and angry expressions were intermediate. In Experiment 2 (N = 67) we replicated our results for posed expressions and introduced a novel paradigm to index communicative emotional expressions. Across Experiments 1 and 2, we demonstrate differences between posed, spontaneous. and communicative expression contexts. Whereas mouth and eyebrow movements reliably distinguished emotions for posed and communicative expressions, only eyebrow movements were reliable for spontaneous expressions. In Experiments 3 and 4 we manipulated facial expression speed and demonstrated a quantifiable change in emotion recognition accuracy. That is, in a discovery (N = 29) and replication sample (N = 41), we showed that speeding up facial expressions promotes anger and happiness judgments. and slowing down expressions encourages sad judgments. This influence of kinematics on emotion recognition is dissociable from the influence of spatial cues. These studies demonstrate that the kinematics of facial movements provide added value, and an independent contribution to emotion recognition.
引用
收藏
页码:1041 / 1061
页数:21
相关论文
共 50 条
  • [21] Newborns' Face Recognition: The Role of Facial Movement
    Leo, Irene
    Angeli, Valentina
    Lunghi, Marco
    Dalla Barba, Beatrice
    Simion, Francesca
    INFANCY, 2018, 23 (01) : 45 - 60
  • [22] Interference with facial emotion recognition by verbal but not visual loads
    Reed, Phil
    Steed, Ian
    RESEARCH IN DEVELOPMENTAL DISABILITIES, 2015, 47 : 441 - 450
  • [23] Facial Emotion Recognition in Bipolar Disorder and Healthy Aging
    Altamura, Mario
    Padalino, Flavia A.
    Stella, Eleonora
    Balzotti, Angela
    Bellomo, Antonello
    Palumbo, Rocco
    Di Domenico, Alberto
    Mammarella, Nicola
    Fairfield, Beth
    JOURNAL OF NERVOUS AND MENTAL DISEASE, 2016, 204 (03) : 188 - 193
  • [24] ONE SHOT EMOTION SCORES FOR FACIAL EMOTION RECOGNITION
    Cruz, Albert C.
    Bhanu, B.
    Thakoor, N. S.
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1376 - 1380
  • [25] Congenital Anosmia and Facial Emotion Recognition
    Drummond, James
    Makdani, Adarsh
    Pawling, Ralph
    Walker, Susannah C.
    PHYSIOLOGY & BEHAVIOR, 2024, 278
  • [26] Facial Expression Study Based on 3D Facial Emotion Recognition
    Cao, HongYuan
    Qi, Chao
    20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 375 - 381
  • [27] Emotion Recognition in Blended Facial Expressions in Women with Anorexia Nervosa
    Dapelo, Marcela Marin
    Surguladze, Simon
    Morris, Robin
    Tchanturia, Kate
    EUROPEAN EATING DISORDERS REVIEW, 2016, 24 (01) : 34 - 42
  • [28] Decoupling of spontaneous facial mimicry from emotion recognition in schizophrenia
    Torregrossa, Lenie J.
    Bian, Dayi
    Wade, Joshua
    Adery, Laura H.
    Ichinose, Megan
    Nichols, Heathman
    Bekele, Esube
    Sarkar, Nilanjan
    Park, Sohee
    PSYCHIATRY RESEARCH, 2019, 275 : 169 - 176
  • [29] Integrating Facial Expression and Body Gesture in Videos for Emotion Recognition
    Yan, Jingjie
    Zheng, Wenming
    Xin, Minhai
    Yan, Jingwei
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (03): : 610 - 613
  • [30] Review of Automatic Emotion Recognition Through Facial Expression Analysis
    Liliana, Dewi Yanti
    Basaruddin, T.
    2018 INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND COMPUTER SCIENCE (ICECOS), 2018, : 231 - 236