CreatureShop: Interactive 3D Character Modeling and Texturing From a Single Color Drawing

被引:1
作者
Zhang, Congyi [1 ]
Yang, Lei [1 ]
Chen, Nenglun [1 ]
Vining, Nicholas [2 ,3 ]
Sheffer, Alla [3 ]
Lau, Francis C. M. [1 ]
Wang, Guoping [4 ]
Wang, Wenping [5 ]
机构
[1] Univ Hong Kong, Hong Kong, Peoples R China
[2] NVIDIA, Toronto, ON, Canada
[3] Univ British Columbia, Vancouver, BC, Canada
[4] Peking Univ, Beijing 100871, Peoples R China
[5] Texas A&M Univ, College Stn, TX 77843 USA
基金
加拿大自然科学与工程研究理事会;
关键词
Three-dimensional displays; Solid modeling; Shape; Surface texture; Geometry; Electronic mail; Annotations; Character modeling; character texturing; interactive techniques; RECONSTRUCTION; ANIMALS;
D O I
10.1109/TVCG.2022.3197560
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Creating 3D shapes from 2D drawings is an important problem with applications in content creation for computer animation and virtual reality. We introduce a new sketch-based system, CreatureShop, that enables amateurs to create high-quality textured 3D character models from 2D drawings with ease and efficiency. CreatureShop takes an input bitmap drawing of a character (such as an animal or other creature), depicted from an arbitrary descriptive pose and viewpoint, and creates a 3D shape with plausible geometric details and textures from a small number of user annotations on the 2D drawing. Our key contributions are a novel oblique view modeling method, a set of systematic approaches for producing plausible textures on the invisible or occluded parts of the 3D character (as viewed from the direction of the input drawing), and a user-friendly interactive system. We validate our system and methods by creating numerous 3D characters from various drawings, and compare our results with related works to show the advantages of our method. We perform a user study to evaluate the usability of our system, which demonstrates that our system is a practical and efficient approach to create fully-textured 3D character models for novice users.
引用
收藏
页码:4874 / 4890
页数:17
相关论文
共 50 条
  • [41] 3D Modeling from Wide Baseline Range Scans using Contour Coherence
    Wang, Ruizhe
    Choi, Jongmoo
    Medioni, Gerard
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 4018 - 4025
  • [42] Tensor-based 3D Color Face Reconstruction Using A Single Image
    Cheng, Wen-Po
    Hsiang, Tien-Ruey
    2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS & VISION (ICARCV), 2012, : 883 - 888
  • [43] A PROCESS FOR THE SEMI-AUTOMATED GENERATION OF LIFE-SIZED, INTERACTIVE 3D CHARACTER MODELS FOR HOLOGRAPHIC PROJECTION
    Huang, Xinyu
    Twycross, John
    Wild, Fridolin
    2019 INTERNATIONAL CONFERENCE ON 3D IMMERSION (IC3D), 2019,
  • [44] View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction
    Zhang, Xuancheng
    Ma, Rui
    Zou, Changqing
    Zhang, Minghao
    Zhao, Xibin
    Gao, Yue
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6546 - 6561
  • [45] Structural Relation Modeling of 3D Point Clouds
    Zheng, Yu
    Lu, Jiwen
    Duan, Yueqi
    Zhou, Jie
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4867 - 4881
  • [46] Deep Exemplar-Based Color Transfer for 3D Model
    Zhang, Mohan
    Liao, Jing
    Yu, Jinhui
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (08) : 2926 - 2937
  • [47] ICM-3D: Instantiated Category Modeling for 3D Instance Segmentation
    Chu, Ruihang
    Chen, Yukang
    Kong, Tao
    Qi, Lu
    Li, Lei
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (01) : 57 - 64
  • [48] Impact of color on polarization-based 3D imaging and countermeasures
    Cai, Yudong
    Liu, Fei
    Shao, Xiaopeng
    Cai, Guocheng
    APPLIED OPTICS, 2022, 61 (21) : 6228 - 6233
  • [49] Joint Hand-Object 3D Reconstruction From a Single Image With Cross-Branch Feature Fusion
    Chen, Yujin
    Tu, Zhigang
    Kang, Di
    Chen, Ruizhi
    Bao, Linchao
    Zhang, Zhengyou
    Yuan, Junsong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4008 - 4021
  • [50] Repairing 3D Models Obtained From Range Sensors
    Perez, Emiliano
    Salamanca, Santiago
    Merchan, Pilar
    Adan, Antonio
    IEEE ACCESS, 2021, 9 : 43474 - 43493