Garment reconstruction from a single-view image based on pixel-aligned implicit function

被引:0
作者
Wentao He
Ning Zhang
Bingpeng Song
Ruru Pan
机构
[1] Jiangnan University,Key Laboratory of Eco
来源
Multimedia Tools and Applications | 2023年 / 82卷
关键词
Garments; Reconstruction; Implicit function; Single-view;
D O I
暂无
中图分类号
学科分类号
摘要
3D garment reconstruction has a wide range of applications in apparel design, digital human body, and virtual try-on. Reconstructing 3D shapes from single-view images is a completely undefined and challenging problem. Recent single-view methods require only single-view images of static or dynamic objects and mine the potential multi-view information in single-view images by statistical, geometric, and physical prior knowledge, which is tedious to obtain. In this paper, we use an implicit function of pixel alignment represented by a neural network to correlate 2D image pixels with the corresponding 3D clothing information for end-to-end training without any relevant prior model. The qualitative and quantitative analysis of the experimental results showed that our results reduced the relative error by an average of 2.6% and the chamfer distance by 2.37% compared to the previous method. Experiments show that our model can reasonably reconstruct the 3D model of garments from their collections of single-view images. Our method can not only capture the overall geometry of the garment but also extract the tiny but important wrinkle details of the fabric. Even with low-resolution input images, our model still achieves available results. In addition, experiments show that the reconstructed 3D models of garments can be used for texture migration and virtual fitting.
引用
收藏
页码:30247 / 30265
页数:18
相关论文
共 71 条
  • [1] Baran I(2007)Automatic rigging and animation of 3d characters ACM Trans Graph 26 72-es-76398
  • [2] Popović J(2020)Hybrid watermarking algorithm using Clifford algebra with Arnold scrambling and chaotic encryption IEEE Access 8 76386-203
  • [3] Bhatti UA(2015)Garment modeling with a depth camera ACM Trans Graph 34 201-280
  • [4] Yu Z(2017)Deepgarment: 3d garment shape estimation from a single image Comput Graph Forum 36 269-9
  • [5] Li J(2010)Stable spaces for real-time clothing ACM Trans Graph 29 1-13
  • [6] Nawaz SA(2016)Fusion4d: real-time performance capture of challenging scenes ACM Trans Graph 35 1-17
  • [7] Mehmood A(2019)Livecap: Real-time human performance capture from monocular video ACM Trans Graph 38 1-2575
  • [8] Zhang K(2020)Disentangled human body embedding based on deep hierarchical neural network IEEE Trans Vis Comput Graph 26 2560-16
  • [9] Yuan L(2015)SMPL: A skinned multi-person linear model ACM Trans Graph 34 1-554
  • [10] Chen X(1989)A shape from shading analysis for a single perspective image of a polyhedron IEEE Trans Pattern Anal Mach Intell 11 545-25