3D facial expression modeling based on facial landmarks in single image

被引:13
|
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [1] Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis
    Huang, Yanhui
    Zhang, Xing
    Fan, Yangyu
    Yin, Lijun
    Seversky, Lee
    Allen, James
    Lei, Tao
    Dong, Weijun
    IMAGE AND VISION COMPUTING, 2012, 30 (10) : 750 - 761
  • [2] 3D Facial Expression Classification Using 3D Facial Surface Normals
    Ujir, Hamimah
    Spann, Michael
    Hipiny, Irwandi Hipni Mohamad
    8TH INTERNATIONAL CONFERENCE ON ROBOTIC, VISION, SIGNAL PROCESSING & POWER APPLICATIONS: INNOVATION EXCELLENCE TOWARDS HUMANISTIC TECHNOLOGY, 2014, 291 : 245 - 253
  • [3] Reproducibility of facial soft tissue landmarks on 3D laser-scanned facial images
    Toma, A. M.
    Zhurov, A.
    Playle, R.
    Ong, E.
    Richmond, S.
    ORTHODONTICS & CRANIOFACIAL RESEARCH, 2009, 12 (01) : 33 - 42
  • [4] Age verification using random forests on facial 3D landmarks
    Jandova, Marie
    Danko, Marek
    Urbanova, Petra
    FORENSIC SCIENCE INTERNATIONAL, 2021, 318
  • [5] Reliability of personal identification base on optical 3D measurement of a few facial landmarks
    Zappa, Emanuele
    Mazzoleni, Paolo
    ICCS 2010 - INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, PROCEEDINGS, 2010, 1 (01): : 2763 - 2771
  • [6] Recognition of 3D facial expression dynamics
    Sandbach, Georgia
    Zafeiriou, Stefanos
    Pantic, Maja
    Rueckert, Daniel
    IMAGE AND VISION COMPUTING, 2012, 30 (10) : 762 - 773
  • [7] Monocular 3D Facial Information Retrieval for Automated Facial Expression Analysis
    Oveneke, Meshia Cedric
    Gonzalez, Isabel
    Wang, Weiyi
    Jiang, Dongmei
    Sahli, Hichem
    2015 INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2015, : 623 - 629
  • [8] Towards a comprehensive 3D dynamic facial expression database
    Frowd, Charlie D.
    Matuszewski, Bogdan J.
    Shark, Lik-Kwan
    Quan, Wei
    PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON SIGNALS, SPEECH AND IMAGE PROCESSING/9TH WSEAS INTERNATIONAL CONFERENCE ON MULTIMEDIA, INTERNET & VIDEO TECHNOLOGIES, 2009, : 113 - +
  • [9] 3D FACIAL EXPRESSION EDITING BASED ON THE DYNAMIC GRAPH MODEL
    Pei, Yuru
    Zha, Hongbin
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1354 - 1357
  • [10] Facial expression generation of 3D avatar based on semantic analysis
    Mukashev, Dinmukhamed
    Kairgaliyev, Merey
    Alibekov, Ulugbek
    Oralbayeva, Nurziya
    Sandygulova, Anara
    2021 30TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2021, : 89 - 94