AR Costumes: Automatically Augmenting Watertight Costumes from a single RGB Image

被引:2
作者
Maurhofer, Christoph [1 ]
Cimen, Gokcen [1 ]
Ryffel, Mattia [2 ]
Sumner, Robert W. [2 ]
Guay, Martin [2 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] Disney Res, Zurich, Switzerland
来源
PROCEEDINGS OF THE 16TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2018) | 2018年
关键词
Costume Fitting; Costume Augmentation; Augmented Reality; Shape Estimation; Inpainting; SHAPE; POSE;
D O I
10.1145/3284398.3284402
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We describe a method to automatically augment a watertight digital costume onto a person's body from a monocular RGB image. When overlaying a digital costume onto a body using pose matching, several parts of the person's cloth or skin remain visible due to differences in shape and proportions. In this paper, we present a practical solution to these artifacts which requires minimal costume parameterization work, and a straightforward inpainting approach. To our knowledge, our approach is the first to deliver plausible watertight costumes from RGB imagery only, and is compatible with mobile devices. We show successful results at high resolution in our video and project web page, as well as defects in the discussion section of paper, which can serve as comparison for future improvements.
引用
收藏
页数:8
相关论文
共 49 条
[1]   2D Human Pose Estimation: New Benchmark and State of the Art Analysis [J].
Andriluka, Mykhaylo ;
Pishchulin, Leonid ;
Gehler, Peter ;
Schiele, Bernt .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3686-3693
[2]   SCAPE: Shape Completion and Animation of People [J].
Anguelov, D ;
Srinivasan, P ;
Koller, D ;
Thrun, S ;
Rodgers, J ;
Davis, J .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :408-416
[3]  
[Anonymous], 2018, INT SERIES INFORM SY
[4]  
[Anonymous], 2006, 2006 IEEE COMP SOC C
[5]  
[Anonymous], 2016, ABS160801250 CORR
[6]  
[Anonymous], 2000, Opencv. Dr. Dobb's journal of software tools
[7]  
Barakonyi Istvan, 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, P145, DOI 10.1109/ISMAR.2006.297806
[8]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[9]   Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image [J].
Bogo, Federica ;
Kanazawa, Angjoo ;
Lassner, Christoph ;
Gehler, Peter ;
Romero, Javier ;
Black, Michael J. .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :561-578
[10]   An adaptable system for RGB-D based human body detection and pose. estimation [J].
Buys, Koen ;
Cagniart, Cedric ;
Baksheev, Anatoly ;
De Laet, Tinne ;
De Schutter, Joris ;
Pantofaru, Caroline .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (01) :39-52