3D facial expression modeling based on facial landmarks in single image

被引:13
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [41] 3D Facial Expression Recognition Using Deep Feature Fusion CNN
    Tian, Kun
    Yin, Qian
    Zeng, Liaoyuan
    Wang, Wenyi
    McGrath, Sean
    2019 30TH IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC), 2019,
  • [42] INTEGRATING FACIAL, GESTURE, AND POSTURE EMOTION EXPRESSION FOR A 3D VIRTUAL AGENT
    Tan, Shawna C. G.
    Nareyek, Alexander
    PROCEEDINGS OF CGAMES 2009 USA - 14TH INTERNATIONAL CONFERENCE ON COMPUTER GAMES: AI, ANIMATION, MOBILE, INTERACTIVE MULTIMEDIA, EDUCATIONAL AND SERIOUS GAMES, 2009, : 23 - 31
  • [43] A High-Resolution Spontaneous 3D Dynamic Facial Expression Database
    Zhang, Xing
    Yin, Lijun
    Cohn, Jeffrey F.
    Canavan, Shaun
    Reale, Michael
    Horowitz, Andy
    Liu, Peng
    2013 10TH IEEE INTERNATIONAL CONFERENCE AND WORKSHOPS ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG), 2013,
  • [44] 3D Facial Plastic Surgery Simulation: Based on the Structured Light
    Rao, Zhi
    Sun, Shuo
    Li, Mingye
    Ji, Xiaoqiang
    Huang, Jipeng
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [45] Single-view-based 3D facial reconstruction method robust against pose variations
    Jo, Jaeik
    Choi, Heeseung
    Kim, Ig-Jae
    Kim, Jaihie
    PATTERN RECOGNITION, 2015, 48 (01) : 73 - 85
  • [46] Automatic 3D Facial Expression Recognition using Geometric Scattering Representation
    Yang, Xudong
    Huang, Di
    Wang, Yunhong
    Chen, Liming
    2015 11TH IEEE INTERNATIONAL CONFERENCE AND WORKSHOPS ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG), VOL. 1, 2015,
  • [47] 3D FACIAL EXPRESSION RECOGNITION USING ZERNIKE MOMENTS ON DEPTH IMAGES
    Vretos, Nicholas
    Nikolaidis, Nikos
    Pitas, Ioannis
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 773 - 776
  • [48] Non-rigid registration based model-free 3D facial expression recognition
    Savran, Arman
    Sankur, Bulent
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 162 : 146 - 165
  • [49] Facial expression recognition based on image pyramid and single-branch decision tree
    Ashir, Abubakar M.
    Eleyan, Alaa
    SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (06) : 1017 - 1024
  • [50] A unified probabilistic framework for automatic 3D facial expression analysis based on a Bayesian belief inference and statistical feature models
    Zhao, Xi
    Dellandrea, Emmanuel
    Zou, Jianhua
    Chen, Liming
    IMAGE AND VISION COMPUTING, 2013, 31 (03) : 231 - 245