3D Face Reconstruction From Single 2D Image Using Distinctive Features

被引:28
作者
Afzal, H. M. Rehan [1 ]
Luo, Suhuai [1 ]
Afzal, M. Kamran [2 ]
Chaudhary, Gopal [3 ]
Khari, Manju [4 ]
Kumar, Sathish A. P. [5 ]
机构
[1] Univ Newcastle, Sch Elect Engn & Comp, Callaghan, NSW 2308, Australia
[2] Xiamen Univ, Sch Comp Sci & Technol, Xiamen 361005, Peoples R China
[3] Bharati Vidyapeeths Coll Engn, Delhi 110063, India
[4] Ambedkar Inst Adv Commun Technol & Res, Delhi 110031, India
[5] Cleveland State Univ, Dept Elect Engn & Comp Sci, Cleveland, OH 44115 USA
关键词
3D face reconstruction; feature extraction; facial modeling; gaussian distribution; RECOGNITION; POSE;
D O I
10.1109/ACCESS.2020.3028106
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D face reconstruction is considered to be a useful computer vision tool, though it is difficult to build. This paper proposes a 3D face reconstruction method, which is easy to implement and computationally efficient. It takes a single 2D image as input, and gives 3D reconstructed images as output. Our method primarily consists of three main steps: feature extraction, depth calculation, and creation of a 3D image from the processed image using a Basel face model (BFM). First, the features of a single 2D image are extracted using a two-step process. Before distinctive-features extraction, a face must be detected to confirm whether one is present in the input image or not. For this purpose, facial features like eyes, nose, and mouth are extracted. Then, distinctive features are mined by using scale-invariant feature transform (SIFT), which will be used for 3D face reconstruction at a later stage. Second step comprises of depth calculation, to assign the image a third dimension. Multivariate Gaussian distribution helps to find the third dimension, which is further tuned using shading cues that are obtained by the shape from shading (SFS) technique. Thirdly, the data obtained from the above two steps will be used to create a 3D image using BFM. The proposed method does not rely on multiple images, lightening the computation burden. Experiments were carried out on different 2D images to validate the proposed method and compared its performance to those of the latest approaches. Experiment results demonstrate that the proposed method is time efficient and robust in nature, and it outperformed all of the tested methods in terms of detail recovery and accuracy.
引用
收藏
页码:180681 / 180689
页数:9
相关论文
共 36 条
[1]   Control and Stabilization of Unmanned Helicopter with Suspended Payload [J].
Afzal, Hassaan ;
Malik, Fahad Mumtaz .
PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON SERVICE ROBOTICS TECHNOLOGIES (ICSRT 2018), 2018, :1-5
[2]   High-Quality Single-Shot Capture of Facial Geometry [J].
Beeler, Thabo ;
Bickel, Bernd ;
Beardsley, Paul ;
Sumner, Bob ;
Gross, Markus .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04)
[3]   High-Quality Passive Facial Performance Capture using Anchor Frames [J].
Beeler, Thabo ;
Hahn, Fabian ;
Bradley, Derek ;
Bickel, Bernd ;
Beardsley, Paul ;
Gotsman, Craig ;
Sumner, Robert W. ;
Gross, Markus .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (04)
[4]   Face recognition based on fitting a 3D morphable model [J].
Blanz, V ;
Vetter, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (09) :1063-1074
[5]   High Resolution Passive Facial Performance Capture [J].
Bradley, Derek ;
Heidrich, Wolfgang ;
Popa, Tiberiu ;
Sheffer, Alla .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04)
[6]   3D Shape Regression for Real-time Facial Animation [J].
Cao, Chen ;
Weng, Yanlin ;
Lin, Stephen ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[7]   Robust local features for remote face recognition [J].
Chen, Jie ;
Patel, Vishal M. ;
Liu, Li ;
Kellokumpu, Vili ;
Zhao, Guoying ;
Pietikainen, Matti ;
Chellappa, Rama .
IMAGE AND VISION COMPUTING, 2017, 64 :34-46
[8]   Iterative Scale-Invariant Feature Transform for Remote Sensing Image Registration [J].
Chen, Shuhan ;
Zhong, Shengwei ;
Xue, Bai ;
Li, Xiaorun ;
Zhao, Liaoying ;
Chang, Chein-I .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (04) :3244-3265
[9]   A Comprehensive Survey on Pose-Invariant Face Recognition [J].
Ding, Changxing ;
Tao, Dacheng .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2016, 7 (03)
[10]  
Grana C, 2013, LECT NOTES COMPUT SC, V8157, P111, DOI 10.1007/978-3-642-41184-7_12