Differences in Facial Expressions between Spontaneous and Posed Smiles: Automated Method by Action Units and Three-Dimensional Facial Landmarks

被引:22
作者
Park, Seho [1 ,2 ,3 ,4 ]
Lee, Kunyoung [5 ]
Lim, Jae-A [3 ,4 ]
Ko, Hyunwoong [1 ,2 ,3 ,4 ]
Kim, Taehoon [6 ]
Lee, Jung-In [6 ]
Kim, Hakrim [6 ]
Han, Seong-Jae [6 ]
Kim, Jeong-Shim [3 ,4 ]
Park, Soowon [7 ]
Lee, Jun-Young [3 ,4 ]
Lee, Eui Chul [8 ]
机构
[1] Seoul Natl Univ, Interdisciplinary Program Cognit Sci, Seoul 08826, South Korea
[2] Seoul Natl Univ, Sch Dent, Dent Res Inst, Seoul 08826, South Korea
[3] Seoul Natl Univ, Dept Psychiat, Coll Med, Seoul 03080, South Korea
[4] SMG SNU Boramae Med Ctr, Seoul 03080, South Korea
[5] Sangmyung Univ, Dept Comp Sci, Seoul 03016, South Korea
[6] Seoul Natl Univ, Coll Med, Seoul 03080, South Korea
[7] Sejong Univ, Dept Educ, Seoul 05006, South Korea
[8] Sangmyung Univ, Dept Human Ctr Artificial Intelligence, Seoul 03016, South Korea
基金
新加坡国家研究基金会;
关键词
emotion; facial recognition; facial asymmetry; three-dimensional analysis; EMOTIONAL EXPRESSION; MOTOR CONTROL; FACE; NEUROPHYSIOLOGY; ASYMMETRY; INVENTORY;
D O I
10.3390/s20041199
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Research on emotion recognition from facial expressions has found evidence of different muscle movements between genuine and posed smiles. To further confirm discrete movement intensities of each facial segment, we explored differences in facial expressions between spontaneous and posed smiles with three-dimensional facial landmarks. Advanced machine analysis was adopted to measure changes in the dynamics of 68 segmented facial regions. A total of 57 normal adults (19 men, 38 women) who displayed adequate posed and spontaneous facial expressions for happiness were included in the analyses. The results indicate that spontaneous smiles have higher intensities for upper face than lower face. On the other hand, posed smiles showed higher intensities in the lower part of the face. Furthermore, the 3D facial landmark technique revealed that the left eyebrow displayed stronger intensity during spontaneous smiles than the right eyebrow. These findings suggest a potential application of landmark based emotion recognition that spontaneous smiles can be distinguished from posed smiles via measuring relative intensities between the upper and lower face with a focus on left-sided asymmetry in the upper region.
引用
收藏
页数:13
相关论文
共 46 条
  • [21] Juhl K. A., 2018, P AS C COMP VIS, P706
  • [22] Measures of Anxiety
    Julian, Laura J.
    [J]. ARTHRITIS CARE & RESEARCH, 2011, 63 : S467 - S472
  • [23] 성형모, 2008, [Journal of the Korean Society of Biological Therapies in Psychiatry, 생물치료정신의학], V14, P201
  • [24] A Brief Review of Facial Emotion Recognition Based on Visual Information
    Ko, Byoung Chul
    [J]. SENSORS, 2018, 18 (02)
  • [25] Static posed and evoked facial expressions of emotions in schizophrenia
    Kohler, Christian G.
    Martin, Elizabeth A.
    Stolar, Neal
    Barrett, Fred S.
    Verma, Ragini
    Brensinger, Colleen
    Bilker, Warren
    Gur, Raquel E.
    Gur, Ruben C.
    [J]. SCHIZOPHRENIA RESEARCH, 2008, 105 (1-3) : 49 - 60
  • [26] Lee Y.H., 1996, J KOREAN NEUROPSYCHI, V35, P888
  • [27] Lim Sun Young, 2011, [Anxiety and Mood, 대한불안의학회지], V7, P48
  • [28] Lucey P., 2010, P 2010 IEEE COMP VIS, P94, DOI [DOI 10.1109/CVPRW.2010.5543262, 10.1109/CVPRW.2010.5543262]
  • [29] Mourao A., 2013, Proceedings of the 21st ACM international conference on Multimedia, P83
  • [30] Cortical control of facial expression
    Mueri, Rene M.
    [J]. JOURNAL OF COMPARATIVE NEUROLOGY, 2016, 524 (08) : 1578 - 1585