Fast and accurate 3D face reconstruction based on facial geometry constraints and fringe projection without phase unwrapping

被引:10
作者
Guo, Yanqiong [1 ]
Duan, Zhijuan [1 ]
Zhang, Ziyou [1 ]
Jing, Hailong [1 ]
An, Shiyong [1 ]
You, Zhisheng [1 ]
机构
[1] Sichuan Univ, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu 610065, Peoples R China
关键词
3D face reconstruction; Facial geometry constraints; Fringe projection; Phase unwrapping; HIGH-SPEED; FREQUENCY; ALGORITHM; PATTERNS;
D O I
10.1016/j.optlaseng.2022.107216
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Phase unwrapping is a critical process and a challenging step in fringe projection profilometry. Methods employ-ing additional auxiliary patterns or embedding signals in the projected fringe pattern can successfully address this issue, but most of them suffer from increased number of structured patterns or depressed signal-to-noise ratio (SNR) of fringe images, which are not expected in real-time high-accuracy application such as 3D face reconstruc-tion. In this paper, a 3D face reconstruction method that completely sidesteps the phase unwrapping process is proposed. Phase order lines (POLs) are first extracted from the left and right wrapped phase map of the stereo vision system respectively, and then the left and right POLs are matched by automatically drawing polylines on the face with facial geometry constraints as prior knowledge. Finally, based on the matched POL pairs, fine matching is performed directly employing the wrapped phase to generate a dense disparity map. Compared with the conventional, the processing time of the proposed method is further improved without sacrificing accuracy. Experiments demonstrate the effectiveness and robustness of the method.
引用
收藏
页数:15
相关论文
共 27 条
[1]   A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition [J].
Bowyer, KW ;
Chang, K ;
Flynn, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2006, 101 (01) :1-15
[2]   Phase unwrapping using geometric constraints for high-speed fringe projection based 3D measurements [J].
Braeuer-Burchardt, Christian ;
Kuehmstedt, Peter ;
Notni, Gunther .
MODELING ASPECTS IN OPTICAL METROLOGY IV, 2013, 8789
[3]  
Chen SY, 2018, 25TH 2018 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), P525, DOI 10.1109/VR.2018.8446494
[4]   High-speed and high-accuracy fringe projection profilometry without phase unwrapping [J].
Deng, Huaxia ;
Ling, Xing ;
Wang, Yuyu ;
Yao, Pengcheng ;
Ma, Mengchao ;
Zhong, Xiang .
OPTICS AND LASERS IN ENGINEERING, 2021, 140
[5]   3D Face Modeling Algorithm for Film and Television Animation Based on Lightweight Convolutional Neural Network [J].
Di, Cheng ;
Peng, Jing ;
Di, Yihua ;
Wu, Siwei .
COMPLEXITY, 2021, 2021
[6]   ZNCC-based template matching using bounded partial correlation [J].
Di Stefano, L ;
Mattoccia, S ;
Tombari, F .
PATTERN RECOGNITION LETTERS, 2005, 26 (14) :2129-2134
[7]   3D reconstruction and validation of historical background for immersive VR applications and games: The case study of the Forum of Augustus in Rome [J].
Ferdani, Daniele ;
Fanini, Bruno ;
Piccioli, Maria Claudia ;
Carboni, Fabiana ;
Vigliarolo, Paolo .
JOURNAL OF CULTURAL HERITAGE, 2020, 43 :129-143
[8]   Two-dimensional phase unwrapping with minimum weighted discontinuity [J].
Flynn, TJ .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1997, 14 (10) :2692-2701
[9]   A two-dimensional region growing least squares phase unwrapping algorithm for interferometric SAR processing [J].
Fornaro, G ;
Sansosti, E .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1999, 37 (05) :2215-2226
[10]   Novel 3D measurement system based on speckle and fringe pattern projection [J].
Gai, Shaoyan ;
Da, Feipeng ;
Dai, Xianqiang .
OPTICS EXPRESS, 2016, 24 (16) :17686-17697