3D facial expression modeling based on facial landmarks in single image

被引:13
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [31] A remarkable standard for estimating the performance of 3D facial expression features
    Li, Xiaoli
    Ruan, Qiuqi
    Ming, Yue
    NEUROCOMPUTING, 2012, 82 : 99 - 108
  • [32] DrFER: Learning Disentangled Representations for 3D Facial Expression Recognition
    Li, Hebeizi
    Yang, Hongyu
    Huang, Di
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [33] Facial image authentication system based on real-time 3D facial imaging by using complex-valued eigenfaces algorithm
    Zhan, Shu
    Kurihara, T.
    Ando, S.
    2006 INTERNATIONAL WORKSHOP ON COMPUTER ARCHITECTURE FOR MACHINE PERCEPTION AND SENSING, 2006, : 220 - +
  • [34] The facial expression of schizophrenic patients applied with infrared thermal facial image sequence
    Jian, Bo-Lin
    Chen, Chieh-Li
    Chu, Wen-Lin
    Huang, Min-Wei
    BMC PSYCHIATRY, 2017, 17
  • [35] Learning deep facial expression features from image and optical flow sequences using 3D CNN
    Zhao, Jianfeng
    Mao, Xia
    Zhang, Jian
    VISUAL COMPUTER, 2018, 34 (10) : 1461 - 1475
  • [36] Expression Robust 3D Facial Landmarking via Progressive Coarse-to-Fine Tuning
    Sun, Jia
    Huang, Di
    Wang, Yunhong
    Chen, Liming
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2019, 15 (01)
  • [37] High-Quality Single Image 3D Facial Shape Reconstruction via Robust Albedo Estimation
    Heo, Suwoong
    Song, Hyewon
    Kang, Jiwoo
    Lee, Sanghoon
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1428 - 1432
  • [38] Muscular Movement Model-Based Automatic 3D/4D Facial Expression Recognition
    Zhen, Qingkai
    Huang, Di
    Wang, Yunhong
    Chen, Liming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (07) : 1438 - 1450
  • [39] Facial Expression Identification Using 3D Geometric Features from Microsoft Kinect Device
    Han, Dongxu
    Al-Jawad, Naseer
    Du, Hongbo
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2016, 2016, 9869
  • [40] Visual facial expression modeling and early predicting from 3D data via subtle feature enhancing
    Su, Lumei
    Lu, Feng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (20) : 12563 - 12580