3D Face Reconstruction and Multimodal Person Identification from Video Captured Using Smartphone Camera

被引:0
作者
Raghavendra, R. [1 ]
Raja, Kiran B. [1 ]
Pflug, Anika [1 ]
Yang, Bian [1 ]
Busch, Christoph [1 ]
机构
[1] Gjovik Univ Coll, Norwegian Biometr Lab, N-2802 Gjovik, Norway
来源
2013 IEEE INTERNATIONAL CONFERENCE ON TECHNOLOGIES FOR HOMELAND SECURITY (HST) | 2013年
关键词
Multiple view reconstruction; 3D Face; Biometrics; Ear recognition; Face recognition; ACTIVE APPEARANCE MODELS; RECOGNITION;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose a novel approach for reconstructing 3D face in real-life scenarios. Our main objective is to address the most challenging issue that involves reconstructing depth information from a video that is recorded from frontal camera of the smartphone. Such videos recorded using smartphones impose lot of challenges, such as motion blur, non-frontal perspectives and low resolution. This limits the applicability of state-of-the-art algorithms, which are mostly based on landmark detection. This situation is addressed with the Scale-Invariant Feature Transformation (SIFT) followed by feature matching to generate consistent tracks. These tracks are further processed to generate a 3D point cloud using Point/Cluster based Multi-view stereo (PMVS/CMVS). The usage of PMVS/CMVS will however fail to generate a dense 3D cloud points on the weak surfaces of face, such as cheeks, nose and forehead. This issue is addressed by multi-view reconstruction of these weakly supported surfaces using Visual-Hull. The effectiveness of our method is evaluated on a newly collected dataset, which simulates a realistic identification scenario using a smartphone.
引用
收藏
页码:552 / 557
页数:6
相关论文
共 28 条
[1]   2D and 3D face recognition: A survey [J].
Abate, Andrea F. ;
Nappi, Michele ;
Riccio, Daniel ;
Sabatino, Gabriele .
PATTERN RECOGNITION LETTERS, 2007, 28 (14) :1885-1906
[2]   A Survey on Ear Biometrics [J].
Abaza, Ayman ;
Ross, Arun ;
Hebert, Christina ;
Harrison, Mary Ann F. ;
Nixon, Mark S. .
ACM COMPUTING SURVEYS, 2013, 45 (02)
[3]   Building Rome in a Day [J].
Agarwal, Sameer ;
Snavely, Noah ;
Simon, Ian ;
Seitz, Steven M. ;
Szeliski, Richard .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :72-79
[4]  
Anjos A., 2011, P INT JOINT C BIOM I, P1, DOI [10.1109/IJCB.2011.6117503., DOI 10.1109/IJCB.2011.6117503]
[5]  
[Anonymous], AUDIO VIDEO BASED BI
[6]   An optimal algorithm for approximate nearest neighbor searching in fixed dimensions [J].
Arya, S ;
Mount, DM ;
Netanyahu, NS ;
Silverman, R ;
Wu, AY .
JOURNAL OF THE ACM, 1998, 45 (06) :891-923
[7]   Automatic construction of active appearance models as an image coding problem [J].
Baker, S ;
Matthews, I ;
Schneider, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (10) :1380-1384
[8]   EigenTracking: Robust matching and tracking of articulated objects using a view-based representation [J].
Black, MJ ;
Jepson, AD .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1998, 26 (01) :63-84
[9]  
Busch C., 2012, NORSK INF NISK
[10]  
Cootes T. F., 2000, BMV2000. Proceedings of the 11th British Machine Vision Conference, P52