Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

被引:19
作者
Shu, Zhenyu [1 ]
Shen, Xiaoyong [2 ]
Xin, Shiqing [3 ]
Chang, Qingjun [1 ]
Feng, Jieqing [4 ]
Kavan, Ladislav [5 ]
Liu, Ligang [6 ]
机构
[1] Zhejiang Univ, Ningbo Inst Technol, Sch Comp & Data Engn, Ningbo, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Peoples R China
[3] ShanDong Univ, Sch Comp Sci & Technol, Jinan, Peoples R China
[4] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[5] Univ Utah, Sch Comp, Salt Lake City, UT USA
[6] Univ Sci & Technol China, Graph & Geometr Comp Lab, Sch Math Sci, Hefei, Anhui, Peoples R China
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Shape; Three-dimensional displays; Training; Labeling; Training data; Solid modeling; Deep learning; 3D shapes; segmentation; scribble; weakly-supervised; deep learning; UNSUPERVISED CO-SEGMENTATION; MESH SEGMENTATION;
D O I
10.1109/TVCG.2019.2892076
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Shape segmentation is a fundamental problem in shape analysis. Previous research shows that prior knowledge helps to improve the segmentation accuracy and quality. However, completely labeling each 3D shape in a large training data set requires a heavy manual workload. In this paper, we propose a novel weakly-supervised algorithm for segmenting 3D shapes using deep learning. Our method jointly propagates information from scribbles to unlabeled faces and learns deep neural network parameters. Therefore, it does not rely on completely labeled training shapes and only needs a really simple and convenient scribble-based partially labeling process, instead of the extremely time-consuming and tedious fully labeling processes. Various experimental results demonstrate the proposed method's superior segmentation performance over the previous unsupervised approaches and comparable segmentation performance to the state-of-the-art fully supervised methods.
引用
收藏
页码:2671 / 2682
页数:12
相关论文
共 40 条
  • [1] Attene M, 2006, IEEE INTERNATIONAL CONFERENCE ON SHAPE MODELING AND APPLICATIONS 2006, PROCEEDINGS, P14
  • [2] Hierarchical mesh segmentation based on fitting primitives
    Attene, M
    Falcidieno, B
    Spagnuolo, M
    [J]. VISUAL COMPUTER, 2006, 22 (03) : 181 - 193
  • [3] Mesh Segmentation with Concavity-Aware Fields
    Au, Oscar Kin-Chung
    Zheng, Youyi
    Chen, Menglin
    Xu, Pengfei
    Tai, Chiew-Lan
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2012, 18 (07) : 1125 - 1134
  • [4] Fast approximate energy minimization via graph cuts
    Boykov, Y
    Veksler, O
    Zabih, R
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) : 1222 - 1239
  • [5] Scale-invariant heat kernel signatures for non-rigid shape recognition
    Bronstein, Michael M.
    Kokkinos, Iasonas
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 1704 - 1711
  • [6] A Benchmark for 3D Mesh Segmentation
    Chen, Xiaobai
    Golovinskiy, Aleksey
    Funkhouser, Thomas
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [7] Cole F, 2008, ACM T GRAPHIC, V27, DOI [10.1145/1360612.1360657, 10.1145/1360612.1360687]
  • [8] Paint Mesh Cutting
    Fan, Lubin
    Liu, Ligang
    Liu, Kun
    [J]. COMPUTER GRAPHICS FORUM, 2011, 30 (02) : 603 - 611
  • [9] Salient geometric features for partial shape matching and similarity
    Gal, R
    Cohen-Or, D
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (01): : 130 - 150
  • [10] Consistent segmentation of 3D models
    Golovinskiy, Aleksey
    Funkhouser, Thomas
    [J]. COMPUTERS & GRAPHICS-UK, 2009, 33 (03): : 262 - 269