CT2Hair: High-Fidelity 3D Hair Modeling using Computed Tomography

被引:6
作者
Shen, Yuefan [1 ,2 ]
Saito, Shunsuke [2 ]
Wang, Ziyan [3 ]
Maury, Olivier [2 ]
Wu, Chenglei [2 ]
Hodgins, Jessica [4 ]
Zheng, Youyi [1 ]
Nam, Giljoo [2 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[2] Meta Real Labs, Redmond, WA 98052 USA
[3] Carnegie Mellon Univ, Meta Real Labs, Pittsburgh, PA 15213 USA
[4] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 04期
关键词
3D modeling; hair modeling; computed tomography; SIMULATION; CAPTURE; IMAGE;
D O I
10.1145/3592106
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce CT2Hair, a fully automatic framework for creating high-fidelity 3D hair models that are suitable for use in downstream graphics applications. Our approach utilizes real-world hair wigs as input, and is able to reconstruct hair strands for a wide range of hair styles. Our method leverages computed tomography (CT) to create density volumes of the hair regions, allowing us to see through the hair unlike image-based approaches which are limited to reconstructing the visible surface. To address the noise and limited resolution of the input density volumes, we employ a coarse-to-fine approach. This process first recovers guide strands with estimated 3D orientation fields, and then populates dense strands through a novel neural interpolation of the guide strands. The generated strands are then refined to conform to the input density volumes. We demonstrate the robustness of our approach by presenting results on a wide variety of hair styles and conducting thorough evaluations on both real-world and synthetic datasets. Code and data for this paper are at github.com/facebookresearch/CT2Hair.
引用
收藏
页数:13
相关论文
共 65 条
  • [1] Non-Linear Anisotropic Diffusion for Memory-Efficient Computed Tomography Super-Resolution Reconstruction
    Abujbara, Khaled
    Idoughi, Ramzi
    Heidrich, Wolfgang
    [J]. 2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 175 - 185
  • [2] A Survey of Image - Based Techniques for Hair Modeling
    Bao, Yongtang
    Qi, Yue
    [J]. IEEE ACCESS, 2018, 6 : 18670 - 18684
  • [3] Coupled 3D Reconstruction of Sparse Facial Hair and Skin
    Beeler, Thabo
    Bickel, Bernd
    Noris, Gioacchino
    Beardsley, Paul
    Marschner, Steve
    Sumner, Robert W.
    Gross, Markus
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):
  • [4] Super-helices for predicting the dynamics of natural hair
    Bertails, Florence
    Audoly, Basile
    Cani, Marie-Paule
    Querleux, Bernard
    Leroy, Frederic
    Leveque, Jean-Luc
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03): : 1180 - 1187
  • [5] A METHOD FOR REGISTRATION OF 3-D SHAPES
    BESL, PJ
    MCKAY, ND
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) : 239 - 256
  • [6] AutoHair: Fully Automatic Hair Modeling from A Single Image
    Chai, Menglei
    Shao, Tianjia
    Wu, Hongzhi
    Weng, Yanlin
    Zhou, Kun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04):
  • [7] High-Quality Hair Modeling from A Single Portrait Photo
    Chai, Menglei
    Luo, Linjie
    Sunkavalli, Kalyan
    Carr, Nathan
    Hadap, Sunil
    Zhou, Kun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (06):
  • [8] Dynamic Hair Manipulation in Images and Videos
    Chai, Menglei
    Wang, Lvdi
    Weng, Yanlin
    Jin, Xiaogang
    Zhou, Kun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04):
  • [9] Single-View Hair Modeling for Portrait Manipulation
    Chai, Menglei
    Wang, Lvdi
    Weng, Yanlin
    Yu, Yizhou
    Guo, Baining
    Zhou, Kun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):
  • [10] A Practical and Controllable Hair and Fur Model for Production Path Tracing
    Chiang, Matt Jen-Yuan
    Bitterli, Benedikt
    Tappan, Chuck
    Burley, Brent
    [J]. COMPUTER GRAPHICS FORUM, 2016, 35 (02) : 275 - 283