3D facial expression modeling based on facial landmarks in single image

被引:13
|
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
国家重点研发计划; 北京市自然科学基金;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [21] Face 2D to 3D Reconstruction Network Based on Head Pose and 3D Facial Landmarks
    Xu, Yuanquan
    Jung, Cheolkon
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [22] Modeling and animation of individualized faces for 3D facial expression synthesis
    Zhang, Y
    Prakash, EC
    Sung, E
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2003, 13 (01) : 42 - 64
  • [23] Hierarchical face modeling and fast 3D facial expression synthesis
    Zhang, Y
    Prakash, EC
    Sung, E
    SIBGRAPI 2002: XV BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2002, : 357 - 364
  • [24] Facial expression recognition using 3D facial feature distances
    Soyel, Hamit
    Demirel, Hasan
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2007, 4633 : 831 - 838
  • [25] 3D Facial Expression Recognition with Geometrically Localized Facial Features
    Soyel, Hamit
    Demirel, Hasan
    23RD INTERNATIONAL SYMPOSIUM ON COMPUTER AND INFORMATION SCIENCES, 2008, : 229 - 232
  • [26] Shape-based Automatic Detection of a Large Number of 3D Facial Landmarks
    Gilani, Syed Zulqarnain
    Shafait, Faisal
    Mian, Ajmal
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 4639 - 4648
  • [27] Generation of 3D facial expressions using 2D facial image
    Lee, HC
    Kim, ES
    Hur, GT
    Choi, HY
    Fourth Annual ACIS International Conference on Computer and Information Science, Proceedings, 2005, : 228 - 232
  • [28] 3D FACIAL EXPRESSION GENERATOR BASED ON TRANSFORMER VAE
    Zou, Kaifeng
    Yu, Boyang
    Seo, Hyewon
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2550 - 2554
  • [29] Deformation-Based 3D Facial Expression Representation
    Demisse, Girum G.
    Aouada, Djamila
    Ottersten, Bjorn
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2018, 14 (01)
  • [30] A PDA based personalized 3D facial expression system
    Chin, Seongah
    Park, Jongkyeong
    COMPUTATIONAL INTELLIGENCE, PT 2, PROCEEDINGS, 2006, 4114 : 468 - 475