3D facial expression modeling based on facial landmarks in single image

被引:13
|
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
国家重点研发计划; 北京市自然科学基金;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [31] 3D Facial Expression Recognition Based on Variation Faces
    Li, Xiaoli
    Ruan, Qiuqi
    An, Gaoyun
    Ruan, Chengxiong
    PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, : 775 - +
  • [32] 3D Smiling Facial Expression Recognition Based on SVM
    Liu, Shuming
    Chen, Xiaopeng
    Fan, Di
    Chen, Xu
    Meng, Fei
    Huang, Qiang
    2016 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2016, : 1661 - 1666
  • [33] A Facial Modeling and Animation System Based on Single Image
    Zhang Mandun
    Qiao Yan
    Wang Yangsheng
    MECHANICAL ENGINEERING AND TECHNOLOGY, 2012, 125 : 143 - +
  • [34] Age verification using random forests on facial 3D landmarks
    Jandova, Marie
    Danko, Marek
    Urbanova, Petra
    FORENSIC SCIENCE INTERNATIONAL, 2021, 318
  • [35] Single-Image Facial Expression Recognition Using Deep 3D Re-Centralization
    Bao, Zhipeng
    You, Shaodi
    Gu, Lin
    Yang, Zhenglu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1628 - 1636
  • [36] 3D facial reconstruction from a single 2D rasterstereography image
    Behlim, Sadaf I.
    Syed, Tahir Q.
    2014 4TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2014, : 303 - 307
  • [37] Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometry
    Wu, Cho-Ying
    Xu, Qiangeng
    Neumann, Ulrich
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 453 - 463
  • [38] A model of facial expression for 3D avatar
    Liu, Zhen
    COMPUTATIONAL SCIENCE - ICCS 2007, PT 3, PROCEEDINGS, 2007, 4489 : 543 - 546
  • [39] Recognition of 3D facial expression dynamics
    Sandbach, Georgia
    Zafeiriou, Stefanos
    Pantic, Maja
    Rueckert, Daniel
    IMAGE AND VISION COMPUTING, 2012, 30 (10) : 762 - 773
  • [40] 3D Facial Expression Analysis and Deformation
    Minoi, Jacey-Lynn
    Gillies, Duncan
    APGV 2007: SYMPOSIUM ON APPLIED PERCEPTION IN GRAPHICS AND VISUALIZATION, PROCEEDINGS, 2007, : 138 - 138