AutoHair: Fully Automatic Hair Modeling from A Single Image

被引:73
作者
Chai, Menglei [1 ]
Shao, Tianjia [1 ]
Wu, Hongzhi [1 ]
Weng, Yanlin [1 ]
Zhou, Kun [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Zhejiang, Peoples R China
来源
ACM TRANSACTIONS ON GRAPHICS | 2016年 / 35卷 / 04期
关键词
hair modeling; image segmentation; data-driven modeling; deep neural network;
D O I
10.1145/2897824.2925961
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce AutoHair, the first fully automatic method for 3D hair modeling from a single portrait image, with no user interaction or parameter tuning. Our method efficiently generates complete and high-quality hair geometries, which are comparable to those generated by the state-of-the-art methods, where user interaction is required. The core components of our method are: a novel hierarchical deep neural network for automatic hair segmentation and hair growth direction estimation, trained over an annotated hair image database; and an efficient and automatic data-driven hair matching and modeling algorithm, based on a large set of 3D hair exemplars. We demonstrate the efficacy and robustness of our method on Internet photos, resulting in a database of around 50K 3D hair models and a corresponding hairstyle space that covers a wide variety of real-world hairstyles. We also show novel applications enabled by our method, including 3D hairstyle space navigation and hair-aware image retrieval.
引用
收藏
页数:12
相关论文
共 52 条
[1]  
[Anonymous], 2013, Caffe: An Open Source Convolutional Architecture for Fast Feature Embedding
[2]  
Balan A.O., 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition, P1, DOI DOI 10.1109/CVPR.2007.383340
[3]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[5]  
Cao XD, 2012, PROC CVPR IEEE, P2887, DOI 10.1109/CVPR.2012.6248015
[6]   High-Quality Hair Modeling from A Single Portrait Photo [J].
Chai, Menglei ;
Luo, Linjie ;
Sunkavalli, Kalyan ;
Carr, Nathan ;
Hadap, Sunil ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (06)
[7]   Dynamic Hair Manipulation in Images and Videos [J].
Chai, Menglei ;
Wang, Lvdi ;
Weng, Yanlin ;
Jin, Xiaogang ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[8]   Single-View Hair Modeling for Portrait Manipulation [J].
Chai, Menglei ;
Wang, Lvdi ;
Weng, Yanlin ;
Yu, Yizhou ;
Guo, Baining ;
Zhou, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)
[9]  
Chen L., 2015, 2015 IEEE CUSTOM INT, P1, DOI DOI 10.1021/LA504333J
[10]   ImageSpirit: Verbal Guided Image Parsing [J].
Cheng, Ming-Ming ;
Zheng, Shuai ;
Lin, Wen-Yan ;
Vineet, Vibhav ;
Sturgess, Paul ;
Crook, Nigel ;
Mitra, Niloy J. ;
Torr, Philip .
ACM TRANSACTIONS ON GRAPHICS, 2014, 34 (01)