A Robust and Fast 3D Face Reconstruction Method Using Realsense Camera

被引:0
作者
Zhang, Jidong [1 ]
Lu, Zongqing [1 ]
Li, Weifeng [1 ]
Liao, Qingmin [1 ]
机构
[1] Tsinghua Univ, Grad Sch Shenzhen, Visual Informat Proc Lab, Shenzhen Key Lab Sci & Technol,Dept Elcet Engn, Beijing, Peoples R China
来源
2017 2ND IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, SIGNAL PROCESSING AND NETWORKING (WISPNET) | 2017年
基金
中国国家自然科学基金;
关键词
real-time face modeling; model deformation; Intel Realsense camera; transformation matrix; MORPHABLE MODEL; SHAPE; IMAGES;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose a fast method to reconstruct a plausible 3D face by deforming a standard face model, constraint to 78 landmarks acquired by Intel realsense camera. First, we calculate the front view coordinates of the 78 landmarks by the Eulerian angle information acquired and scale the front view coordinates to fit the standard model. Second, we calculate a transformation matrix which calculate the displacement of all the points in the face through the displacement of the landmarks. Finally, based on the results of the second, we adjust all the points of the model to best fit the real face. Experimental results demonstrate the effectiveness and efficiency of our method, as well as the robust adaptation to face pose and efficiency of the algorithm.
引用
收藏
页码:2691 / 2695
页数:5
相关论文
共 18 条
[1]  
[Anonymous], 2015, ARXIV150906161
[2]   Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images [J].
Atick, JJ ;
Griffin, PA ;
Redlich, AN .
NEURAL COMPUTATION, 1996, 8 (06) :1321-1340
[3]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[4]   Face Alignment by Explicit Shape Regression [J].
Cao, Xudong ;
Wei, Yichen ;
Wen, Fang ;
Sun, Jian .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2014, 107 (02) :177-190
[5]  
Draelos M, 2015, IEEE IMAGE PROC, P2520, DOI 10.1109/ICIP.2015.7351256
[6]   Viewing Real-World Faces in 3D [J].
Hassner, Tal .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :3607-3614
[7]   Efficient 3D reconstruction for face recognition [J].
Jiang, DL ;
Hu, YX ;
Yan, SC ;
Zhang, L ;
Zhang, HJ ;
Gao, W .
PATTERN RECOGNITION, 2005, 38 (06) :787-798
[8]   3D Face Reconstruction from a Single Image Using a Single Reference Face Shape [J].
Kemelmacher-Shlizerman, Ira ;
Basri, Ronen .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) :394-405
[9]  
KEMELMACHERSHLIZER, 2013, P IEEE INT C COMP VI, P3256, DOI DOI 10.1109/ICCV.2013.404
[10]   A SfM-based 3D face reconstruction method robust to self-occlusion by using a shape conversion matrix [J].
Lee, Sung Joo ;
Park, Kang Ryoung ;
Kim, Jaihie .
PATTERN RECOGNITION, 2011, 44 (07) :1470-1486