HairBrush for Immersive Data-Driven Hair Modeling

被引:15
作者
Xing, Jun [1 ]
Nagano, Koki [2 ]
Chen, Weikai [1 ]
Xu, Haotian [3 ]
Wei, Li-Yi [4 ]
Zhao, Yajie [1 ]
Lu, Jingwan [4 ]
Kim, Byungmoon [4 ]
Li, Hao [1 ,2 ]
机构
[1] USC Inst Creat Technol, Los Angeles, CA 90094 USA
[2] Pinscreen, Los Angeles, CA USA
[3] Wayne State Univ, Detroit, MI 48202 USA
[4] Adobe Res, Seattle, WA USA
来源
PROCEEDINGS OF THE 32ND ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY (UIST 2019) | 2019年
关键词
hair; modeling; virtual reality; data-driven; machine learning; user interface;
D O I
10.1145/3332165.3347876
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
While hair is an essential component of virtual humans, it is also one of the most challenging digital assets to create. Existing automatic techniques lack the generality and flexibility to create rich hair variations, while manual authoring interfaces often require considerable artistic skills and efforts, especially for intricate 3D hair structures that can be difficult to navigate. We propose an interactive hair modeling system that can help create complex hairstyles in minutes or hours that would otherwise take much longer with existing tools. Modelers, including novice users, can focus on the overall hairstyles and local hair deformations, as our system intelligently suggests the desired hair parts. Our method combines the flexibility of manual authoring and the convenience of data-driven automation. Since hair contains intricate 3D structures such as buns, knots, and strands, they are inherently challenging to create using traditional 2D interfaces. Our system provides a new 3D hair authoring interface for immersive interaction in virtual reality (VR). Users can draw high-level guide strips, from which our system predicts the most plausible hairstyles via a deep neural network trained from a professionally curated dataset. Each hairstyle in our dataset is composed of multiple variations, serving as blend-shapes to fit the user drawings via global blending and local deformation. The fitted hair models are visualized as interactive suggestions that the user can select, modify, or ignore. We conducted a user study to confirm that our system can significantly reduce manual labor while improve the output quality for modeling a variety of head and facial hairstyles that are challenging to create via existing techniques.
引用
收藏
页码:263 / 279
页数:17
相关论文
共 47 条
[1]  
[Anonymous], ACM T GRAPH
[2]   3D Hair sketching for real-time dynamic & key frame animations [J].
Aras, Rifat ;
Basarankut, Barkin ;
Capin, Tolga ;
Oezguec, Buelent .
VISUAL COMPUTER, 2008, 24 (7-9) :577-585
[3]   Experimental Evaluation of Sketching on Surfaces in VR [J].
Arora, Rahul ;
Kazi, Rubaiat Habib ;
Anderson, Fraser ;
Grossman, Tovi ;
Singh, Karan ;
Fitzmaurice, George .
PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17), 2017, :5643-5654
[4]   Discrete elastic rods [J].
Bergou, Miklos ;
Wardetzky, Max ;
Robinson, Stephen ;
Audoly, Basile ;
Grinspun, Eitan .
ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03)
[5]   Super-helices for predicting the dynamics of natural hair [J].
Bertails, Florence ;
Audoly, Basile ;
Cani, Marie-Paule ;
Querleux, Bernard ;
Leroy, Frederic ;
Leveque, Jean-Luc .
ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03) :1180-1187
[6]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[7]  
Brock A., 2016, ARXIV160907093
[8]   AutoHair: Fully Automatic Hair Modeling from A Single Image [J].
Chai, Menglei ;
Shao, Tianjia ;
Wu, Hongzhi ;
Weng, Yanlin ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04)
[9]   Dynamic Hair Manipulation in Images and Videos [J].
Chai, Menglei ;
Wang, Lvdi ;
Weng, Yanlin ;
Jin, Xiaogang ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[10]   Single-View Hair Modeling for Portrait Manipulation [J].
Chai, Menglei ;
Wang, Lvdi ;
Weng, Yanlin ;
Yu, Yizhou ;
Guo, Baining ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)