Quantifying dynamic facial expressions under naturalistic conditions

被引:6
|
作者
Jeganathan, Jayson [1 ,2 ]
Campbell, Megan [1 ,2 ]
Hyett, Matthew [3 ]
Parker, Gordon [4 ]
Breakspear, Michael [5 ]
机构
[1] Univ Newcastle, Coll Engn Sci & Environm, Sch Psychol, Newcastle, Australia
[2] Hunter Med Res Inst, Newcastle, Australia
[3] Univ Western Australia, Sch Psychol Sci, Perth, Australia
[4] Univ New South Wales, Sch Psychiat, Kensington, Australia
[5] Univ Newcastle, Coll Med Hlth & Wellbeing, Sch Med & Publ Hlth, Newcastle, Australia
来源
ELIFE | 2022年 / 11卷
基金
英国医学研究理事会; 澳大利亚研究理事会;
关键词
facial expression; major depressive disorder; naturalistic; Human; RECOGNITION; SEQUENCES;
D O I
10.7554/eLife.79581
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Facial affect is expressed dynamically - a giggle, grimace, or an agitated frown. However, the characterisation of human affect has relied almost exclusively on static images. This approach cannot capture the nuances of human communication or support the naturalistic assessment of affective disorders. Using the latest in machine vision and systems modelling, we studied dynamic facial expressions of people viewing emotionally salient film clips. We found that the apparent complexity of dynamic facial expressions can be captured by a small number of simple spatiotemporal states - composites of distinct facial actions, each expressed with a unique spectral fingerprint. Sequential expression of these states is common across individuals viewing the same film stimuli but varies in those with the melancholic subtype of major depressive disorder. This approach provides a platform for translational research, capturing dynamic facial expressions under naturalistic conditions and enabling new quantitative tools for the study of affective disorders and related mental illnesses.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Enhanced subliminal emotional responses to dynamic facial expressions
    Sato, Wataru
    Kubota, Yasutaka
    Toichi, Motomi
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [22] Facial Expressions in Context: Electrophysiological Correlates of the Emotional Congruency of Facial Expressions and Background Scenes
    Xu, Qiang
    Yang, Yaping
    Tan, Qun
    Zhang, Lin
    FRONTIERS IN PSYCHOLOGY, 2017, 8
  • [23] Quantifying facial expression recognition across viewing conditions
    Goren, D
    Wilson, HR
    VISION RESEARCH, 2006, 46 (8-9) : 1253 - 1262
  • [24] Perceptual Learning of Facial Expressions
    Du, Yangyang
    Zhang, Fan
    Wang, Yongchao
    Bi, Taiyong
    Qiu, Jiang
    VISION RESEARCH, 2016, 128 : 19 - 29
  • [25] Facial expressions analysis under occlusions based on specificities of facial motion propagation
    Poux, Delphine
    Allaert, Benjamin
    Mennesson, Jose
    Ihaddadene, Nacim
    Bilasco, Ioan Marius
    Djeraba, Chaabane
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (15) : 22405 - 22427
  • [26] Analyzing facial expressions in depression
    Bediou, Benoit
    Saoud, Mohamed
    Harmer, Catherine
    Krolak-Salmon, Pierre
    EVOLUTION PSYCHIATRIQUE, 2009, 74 (01): : 79 - 91
  • [27] The influence of facial expressions on recognition performance in facial identity
    Pavel, Florin Alexandru
    Iordanescu, Eugen
    PSIWORLD 2011, 2012, 33 : 548 - 552
  • [28] Development of the RIKEN database for dynamic facial expressions with multiple angles
    Namba, Shushi
    Sato, Wataru
    Namba, Saori
    Nomiya, Hiroki
    Shimokawa, Koh
    Osumi, Masaki
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [29] Common cues to emotion in the dynamic facial expressions of speech and song
    Livingstone, Steven R.
    Thompson, William F.
    Wanderley, Marcelo M.
    Palmer, Caroline
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2015, 68 (05) : 952 - 970
  • [30] Brain networks subserving the evaluation of static and dynamic facial expressions
    Johnston, Patrick
    Mayes, Angela
    Hughes, Matthew
    Young, Andrew W.
    CORTEX, 2013, 49 (09) : 2462 - 2472