3-D Reconstruction of Human Body Shape From a Single Commodity Depth Camera

被引:29
作者
Zhao, Tianhao [1 ]
Li, Songnan [1 ]
Ngan, King Ngi [1 ,2 ]
Wu, Fanzi [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Sichuan, Peoples R China
关键词
Human body shape; model fitting; PCA shape space; depth camera; human pose estimation; REAL-TIME; TRACKING; OBJECTS; MODEL; POSE;
D O I
10.1109/TMM.2018.2844087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3-D human body reconstruction is an important research topic in computer vision. A 3-D human body model can be used in sports science, movie industry and personalized entertainment, especially virtual reality games. Most of depth-based 3-D reconstruction algorithms need multiple cameras surrounding the user and require the user to keep a specific pose strictly while capturing depth images. In this paper, we propose an algorithm to reconstruct the 3-D shape of human bodies using a single commodity depth camera. Our algorithm only needs two depth images of the front-facing and back-facing bodies. It also has strong operability since the proposed method is insensitive to the pose variations between the two depth images. We reconstruct 3-D shapes of front-facing and back-facing bodies from the two depth images, respectively, and stitch them together. We also propose a novel registration method, namely, "iterative mid-distance points," which has fast convergence and robustness to the depth noise. The proposed method enables robust and easy-to-use human body reconstruction, and achieves higher accuracy than state-of-the-art methods.
引用
收藏
页码:114 / 123
页数:10
相关论文
共 41 条
[1]   Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras [J].
Alexiadis, Dimitrios S. ;
Zarpalas, Dimitrios ;
Daras, Petros .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (02) :339-358
[2]   SCAPE: Shape Completion and Animation of People [J].
Anguelov, D ;
Srinivasan, P ;
Koller, D ;
Thrun, S ;
Rodgers, J ;
Davis, J .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :408-416
[3]  
[Anonymous], 2014, ACM T GRAPHIC, DOI DOI 10.1145/2601097.2601165
[4]  
Baran I, 2007, ACM T GRAPHIC, V26, DOI [10.1145/1239451.1239523, 10.1145/1276377.1276467]
[5]  
BESL PJ, 1992, P SOC PHOTO-OPT INS, V1611, P586, DOI 10.1117/12.57955
[6]   Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences [J].
Bogo, Federica ;
Black, Michael J. ;
Loper, Matthew ;
Romero, Javier .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2300-2308
[7]   Global Registration of Dynamic Range Scans for Articulated Model Reconstruction [J].
Chang, Will ;
Zwicker, Matthias .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (03) :1-15
[8]   Tensor-Based Human Body Modeling [J].
Chen, Yinpeng ;
Liu, Zicheng ;
Zhang, Zhengyou .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :105-112
[9]   Parametric Human Body Reconstruction Based on Sparse Key Points [J].
Cheng, Ke-Li ;
Tong, Ruo-Feng ;
Tang, Min ;
Qian, Jing-Ye ;
Sarkis, Michel .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2016, 22 (11) :2467-2479
[10]  
Cignoni P., 2008, 6 EUR IT CHAPT C, V73, P129