Pose Estimation and Conversion to Front Viewing Facial Image Using 3D Head Model

被引:1
作者
Shiau, Jyh-Bin [1 ]
Pu, Chang-En [1 ]
Leu, Jia-Guu [2 ]
机构
[1] Minist Justice Invest, Dept Forens Sci, Bureau, Taipei County, Peoples R China
[2] Natl Taipei Univ, Grad Sch Commun Eneg, Taipei, Taiwan
来源
44TH ANNUAL 2010 IEEE INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY | 2010年
关键词
3D Head Model; Pose Estimation; Conversion to Front Viewing Facial Image; Pose Invariant Face Recognition; FACE DETECTION;
D O I
10.1109/CCST.2010.5678691
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Surveillance cameras are usually mounted near ceiling and pointing downward at an angle. Face images acquired usually are not frontal instead of faces looking downward or sideways. However, the face images collected in databases are frontal face images posing a problem of face recognition. Using skin color and shape analysis to detect the face, eyes and mouth then location of the head determined in 3D space based on perspective projection. Face parts not visible by the camera including parts facing away from the camera and that are obstructed by other face parts, that can be estimated from the angle between the surface normal and the vector pointing toward the camera. For converting to front viewing, two camera calibration matrices were established, one for physical camera situated right in front of the detected head and the other for virtual camera. By using calibration matrices location of the projection of a point in the 3D space on the image planes determined. For each face part (a triangle) that is visible by both cameras, we find its image in the face seen by the physical camera, apply affine transform to change its shape and size, and paste it onto its location seen by the virtual camera to accomplish pose conversion to a front viewing face. We verified that for a tilt angle (looking downward) ranging from 0 to 40 degrees, and/or a slant angle (face turning left or right) ranging from -60 degrees to +60 degrees, our approach is able to convert non-front viewing face to a front viewing face.
引用
收藏
页码:179 / 184
页数:6
相关论文
共 50 条
[41]   3D pose estimation of symmetrical objects of unknown shape [J].
Penman, David W. ;
Alwesh, Nawar S. .
IMAGE AND VISION COMPUTING, 2006, 24 (05) :447-454
[42]   3D Human Pose Estimation With Spatial Structure Information [J].
Huang, Xiaoshan ;
Huang, Jun ;
Tang, Zengming .
IEEE ACCESS, 2021, 9 :35947-35956
[43]   Domain-Translated 3D Object Pose Estimation [J].
Papaioannidis, Christos ;
Mygdalis, Vasileios ;
Pitas, Ioannis .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :9279-9291
[44]   Generic 3D Representation via Pose Estimation and Matching [J].
Zamir, Amir R. ;
Wekel, Tilman ;
Agrawal, Pulkit ;
Wei, Colin ;
Malik, Jitendra ;
Savarese, Silvio .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :535-553
[45]   3D Hand Pose Estimation on Conventional Capacitive Touchscreens [J].
Choi, Frederick ;
Mayer, Sven ;
Harrison, Chris .
PROCEEDINGS OF 23RD ACM INTERNATIONAL CONFERENCE ON MOBILE HUMAN-COMPUTER INTERACTION (MOBILEHCI 2021): MOBILE APART, MOBILE TOGETHER, 2021,
[46]   Robust Landmark Selection for 3D Face Pose Estimation [J].
Civir, Cevdet ;
Topal, Cihan .
2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
[47]   3D Object Retrieval and Pose Estimation for a Single-view Query Image in a Mobile Environment [J].
Tak, Yoon-Sik ;
Hwang, Eenjun .
PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCES ON ADVANCES IN MULTIMEDIA (MMEDIA 2011), 2011, :62-67
[48]   Pose-invariant face recognition using a 3D deformable model [J].
Lee, MW ;
Ranganath, S .
PATTERN RECOGNITION, 2003, 36 (08) :1835-1846
[49]   FACIAL POSE ESTIMATION USING ACTIVE APPEARANCE MODELS AND A GENERIC FACE MODEL [J].
Gernoth, Thorsten ;
Martinez, Katerina Alonso ;
Goossen, Andre ;
Grigat, Rolf-Rainer .
VISAPP 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, 2010, :499-506
[50]   Single 2D Image-based 3D Face Reconstruction and Its Application in Pose Estimation [J].
Gong, Xun ;
Wang, Guoyin ;
Xiong, Lili .
FUNDAMENTA INFORMATICAE, 2009, 94 (02) :179-195