Data-Driven 3-D Human Body Customization With a Mobile Device

被引:10
作者
Song, Dan [1 ]
Tong, Ruofeng [1 ]
Du, Jiang [1 ]
Zhang, Yun [2 ]
Jin, Yao [3 ]
机构
[1] Zhejiang Univ, State Key Lab CAD & CG, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ Media & Commun, Inst Zhejiang Radio & TV Technol, Hangzhou 310027, Zhejiang, Peoples R China
[3] Zhejiang Sci Tech Univ, Coll Informat Sci & Technol, Hangzhou 310027, Zhejiang, Peoples R China
来源
IEEE ACCESS | 2018年 / 6卷
关键词
Body parameters regression; data-driven application; image-based 3-D body shape estimation; HUMAN BODIES; HUMAN SHAPE; RECONSTRUCTION; MODEL; POSE;
D O I
10.1109/ACCESS.2018.2837147
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is more convincing for users to have their own 3-D body shapes in the virtual fitting room when they shop clothes online. However, existing methods are limited for ordinary users to efficiently and conveniently access their 3-D bodies. We propose an efficient data-driven approach and develop an android application for 3-D body customization. Users stand naturally and their photos are taken from front and side views with a handy phone camera. They can wear casual clothes like a short-sleeved/long-sleeved shirt and short/long pants. First, we develop a user-friendly interface to semi-automatically segment the human body from photos. Then, the segmented human contours are scaled and translated to the ones under our virtual camera configurations. Through this way, we only need one camera to take photos of human in two views and do not need to calibrate the camera, which satisfy the convenience requirement. Finally, we learn body parameters that determine the 3-D body from dressed-human silhouettes with cascaded regressors. The regressors are trained using a database containing 3-D naked and dressed body pairs. Body parameters regression only costs 1.26 s on an android phone, which ensures the efficiency of our method. We invited 12 volunteers for tests, and the mean absolute estimation error for chest/waist/hip size is 2.89/1.93/2.22 centimeters. We additionally use 637 synthetic data to evaluate the main procedures of our approach.
引用
收藏
页码:27939 / 27948
页数:10
相关论文
共 31 条
[1]   SCAPE: Shape Completion and Animation of People [J].
Anguelov, D ;
Srinivasan, P ;
Koller, D ;
Thrun, S ;
Rodgers, J ;
Davis, J .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :408-416
[2]  
[Anonymous], 2013, ACM T GRAPHICS
[3]  
Balan AO, 2008, LECT NOTES COMPUT SC, V5303, P15, DOI 10.1007/978-3-540-88688-4_2
[4]  
Ballester A., 2016, Int. J. Digit. Hum., V1, P361, DOI [10.1504/ijdh.2016.10005376, DOI 10.1504/IJDH.2016.10005376, 10.1504/ijdh.2016.084581, DOI 10.1504/IJDH.2016.084581]
[5]   Three-dimensional human shape inference from silhouettes: reconstruction and validation [J].
Boisvert, Jonathan ;
Shu, Chang ;
Wuhrer, Stefanie ;
Xi, Pengcheng .
MACHINE VISION AND APPLICATIONS, 2013, 24 (01) :145-157
[6]   Real-time Facial Animation with Image-based Dynamic Avatars [J].
Cao, Chen ;
Wu, Hongzhi ;
Weng, Yanlin ;
Shao, Tianjia ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04)
[7]   3D Shape Regression for Real-time Facial Animation [J].
Cao, Chen ;
Weng, Yanlin ;
Lin, Stephen ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[8]   Face Alignment by Explicit Shape Regression [J].
Cao, Xudong ;
Wei, Yichen ;
Wen, Fang ;
Sun, Jian .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2014, 107 (02) :177-190
[9]   Deformable model for estimating clothed and naked human shapes from a single image [J].
Chen, Xiaowu ;
Guo, Yu ;
Zhou, Bin ;
Zhao, Qinping .
VISUAL COMPUTER, 2013, 29 (11) :1187-1196
[10]   Parametric Human Body Reconstruction Based on Sparse Key Points [J].
Cheng, Ke-Li ;
Tong, Ruo-Feng ;
Tang, Min ;
Qian, Jing-Ye ;
Sarkis, Michel .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2016, 22 (11) :2467-2479