Differences in Facial Expressions between Spontaneous and Posed Smiles: Automated Method by Action Units and Three-Dimensional Facial Landmarks

被引:22
作者
Park, Seho [1 ,2 ,3 ,4 ]
Lee, Kunyoung [5 ]
Lim, Jae-A [3 ,4 ]
Ko, Hyunwoong [1 ,2 ,3 ,4 ]
Kim, Taehoon [6 ]
Lee, Jung-In [6 ]
Kim, Hakrim [6 ]
Han, Seong-Jae [6 ]
Kim, Jeong-Shim [3 ,4 ]
Park, Soowon [7 ]
Lee, Jun-Young [3 ,4 ]
Lee, Eui Chul [8 ]
机构
[1] Seoul Natl Univ, Interdisciplinary Program Cognit Sci, Seoul 08826, South Korea
[2] Seoul Natl Univ, Sch Dent, Dent Res Inst, Seoul 08826, South Korea
[3] Seoul Natl Univ, Dept Psychiat, Coll Med, Seoul 03080, South Korea
[4] SMG SNU Boramae Med Ctr, Seoul 03080, South Korea
[5] Sangmyung Univ, Dept Comp Sci, Seoul 03016, South Korea
[6] Seoul Natl Univ, Coll Med, Seoul 03080, South Korea
[7] Sejong Univ, Dept Educ, Seoul 05006, South Korea
[8] Sangmyung Univ, Dept Human Ctr Artificial Intelligence, Seoul 03016, South Korea
基金
新加坡国家研究基金会;
关键词
emotion; facial recognition; facial asymmetry; three-dimensional analysis; EMOTIONAL EXPRESSION; MOTOR CONTROL; FACE; NEUROPHYSIOLOGY; ASYMMETRY; INVENTORY;
D O I
10.3390/s20041199
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Research on emotion recognition from facial expressions has found evidence of different muscle movements between genuine and posed smiles. To further confirm discrete movement intensities of each facial segment, we explored differences in facial expressions between spontaneous and posed smiles with three-dimensional facial landmarks. Advanced machine analysis was adopted to measure changes in the dynamics of 68 segmented facial regions. A total of 57 normal adults (19 men, 38 women) who displayed adequate posed and spontaneous facial expressions for happiness were included in the analyses. The results indicate that spontaneous smiles have higher intensities for upper face than lower face. On the other hand, posed smiles showed higher intensities in the lower part of the face. Furthermore, the 3D facial landmark technique revealed that the left eyebrow displayed stronger intensity during spontaneous smiles than the right eyebrow. These findings suggest a potential application of landmark based emotion recognition that spontaneous smiles can be distinguished from posed smiles via measuring relative intensities between the upper and lower face with a focus on left-sided asymmetry in the upper region.
引用
收藏
页数:13
相关论文
共 46 条
  • [1] [Anonymous], 2016, Advances in Face Detection and Facial Image Analysis, DOI 10.1007/978-3-319-25958-1_4
  • [2] [Anonymous], 2016, P IEEE WINT C APPL C
  • [3] [Anonymous], 2011, International Journal of Wavelets Multiresolution and Information Processing, DOI [DOI 10.1142/S021969130400041X, 10.1142/S021969130400041X]
  • [4] Assari Mohammad Amin, 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA 2011), P337, DOI 10.1109/ICSIPA.2011.6144162
  • [5] THE 20-ITEM TORONTO-ALEXITHYMIA-SCALE .1. ITEM SELECTION AND CROSS-VALIDATION OF THE FACTOR STRUCTURE
    BAGBY, RM
    PARKER, JDA
    TAYLOR, GJ
    [J]. JOURNAL OF PSYCHOSOMATIC RESEARCH, 1994, 38 (01) : 23 - 32
  • [6] Baltruaitis T., 2015, P 11 IEEE INT C WORK
  • [7] Baltruaitis T., 2018, P 13 IEEE INT C AUT
  • [8] AN INVENTORY FOR MEASURING CLINICAL ANXIETY - PSYCHOMETRIC PROPERTIES
    BECK, AT
    BROWN, G
    EPSTEIN, N
    STEER, RA
    [J]. JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY, 1988, 56 (06) : 893 - 897
  • [9] AN INVENTORY FOR MEASURING DEPRESSION
    BECK, AT
    ERBAUGH, J
    WARD, CH
    MOCK, J
    MENDELSOHN, M
    [J]. ARCHIVES OF GENERAL PSYCHIATRY, 1961, 4 (06) : 561 - &
  • [10] Bihan Jiang, 2011, Proceedings 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG 2011), P314, DOI 10.1109/FG.2011.5771416