3D face reconstruction using images from cameras with varying parameters

被引：17
作者：
Merras M. [1 ]
El Hazzat S. [1 ]
Saaidi A. [1 ,2 ]
Satori K. [1 ]
Nazih A.G. [1 ]
机构：
[1] LIIAN, Department of Mathematics and Computer Science, Faculty of Sciences, Dhar-Mahraz, Sidi Mohamed Ben Abdellah University, B. P 1796, Atlas-Fez
[2] LSI, Department of Mathematics, Physics and Computer Science, Polydisciplinary Faculty of Taza, Sidi Mohamed Ben Abdellah University, B. P 1223, Taza
来源：
International Journal of Automation and Computing | 2017年 / 14卷 / 6期
关键词：
3D face; 3D mesh; 3D reconstruction; Camera calibration; genetic algorithm;
D O I：
10.1007/s11633-016-0999-x
中图分类号：
学科分类号：
摘要：
In this paper, we present a new technique of 3D face reconstruction from a sequence of images taken with cameras having varying parameters without the need to grid. This method is based on the estimation of the projection matrices of the cameras from a symmetry property which characterizes the face, these projections matrices are used with points matching in each pair of images to determine the 3D points cloud, subsequently, 3D mesh of the face is constructed with 3D Crust algorithm. Lastly, the 2D image is projected on the 3D model to generate the texture mapping. The strong point of the proposed approach is to minimize the constraints of the calibration system: we calibrated the cameras from a symmetry property which characterizes the face, this property gives us the opportunity to know some points of 3D face in a specific well-chosen global reference, to formulate a system of linear and nonlinear equations according to these 3D points, their projection in the image plan and the elements of the projections matrix. Then to solve these equations, we use a genetic algorithm which consists of finding the global optimum without the need of the initial estimation and allows to avoid the local minima of the formulated cost function. Our study is conducted on real data to demonstrate the validity and the performance of the proposed approach in terms of robustness, simplicity, stability and convergence. © 2016, Institute of Automation, Chinese Academy of Sciences and Springer-Verlag GmbH Germany.
引用
收藏
页码：661 / 671
页数：10
相关论文
共 28 条
  • [1] Ansari A.N., Abdel-Mottaleb M., 3D face modeling using two orthogonal views and a generic face model, Proceedings of International Conference on Multimedia and Expo, 3, pp. 289-292, (2003)
  • [2] Achermann B., Bunke H., Classifying range images of human faces with Hausdorff distance, Proceedings of the 15th International Conference on Pattern Recognition, IEEE, Barcelona, Spain, 2, pp. 809-813, (2000)
  • [3] Atick J.J., Griffin P.A., Redlich A.N., Statistical approach to shape from shading: Reconstruction of 3D face surfaces from single 2D images, Neural Computation, 8, 6, pp. 1321-1340, (1996)
  • [4] Pighin F., Hecker J., Lischinski D., Szeliski R., Salesin D.H., Synthesizing realistic facial expressions from photographs, Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 75-84, (1998)
  • [5] Lengagne R., Fua P., Monga O., 3D face modeling from stereo and differential constraints, Proceedings of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition, IEEE, Nara, Japan, pp. 148-153, (1998)
  • [6] Lin M., Li B., Liu Q.H., Identification of eye movements from non-frontal face images for eye-controlled systems, International Journal of Automation and Computing, 11, 5, pp. 543-554, (2014)
  • [7] Wang L., Li R.F., Wang K., Chen J., Feature representation for facial expression recognition based on FACS and LBP, International Journal of Automation and Computing, 11, 5, pp. 459-468, (2014)
  • [8] Chouvatut V., Madarasmi S., Tuceryan M., Face reconstruction and camera pose using multi-dimensional descent, World Academy of Sciences, Engineering and Technology, 60, pp. 730-735, (2009)
  • [9] Liang R.H., Pan Z.G., Chen C., New algorithm for 3D facial model reconstruction and its application in virtual reality, Journal of Computer Science and Technology, 19, 4, pp. 501-509, (2004)
  • [10] Cheng W.C., Chang C.F., 3D face reconstruction using the stereo camera and neural network regression, Proceedings of International Conference on Artificial Intelligence and Applications, (2009)
123