Learning from Synthetic Point Cloud Data for Historical Buildings Semantic Segmentation

被引:41
作者
Morbidoni, Christian [1 ]
Pierdicca, Roberto [2 ]
Paolanti, Marina [1 ]
Quattrini, Ramona [2 ]
Mammoli, Raissa [2 ]
机构
[1] Univ Politecn Marche DII, Via Brecce Bianche, I-60131 Ancona, Italy
[2] Univ Politecn Marche DICEA, Via Brecce Bianche, I-60131 Ancona, Italy
来源
ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE | 2020年 / 13卷 / 04期
关键词
Deep learning; point cloud semantic segmentation; synthetic point cloud; cultural heritage; historical building; dynamic graph convolutional neural network; radius distance; scan-to-BIM;
D O I
10.1145/3409262
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Historical heritage is demanding robust pipelines for obtaining Heritage Building Information Modeling models that are fully interoperable and rich in their informative content. The definition of efficient Scan-to-BIM workflows represent a very important step toward a more efficient management of the historical real estate, as creating structured three-dimensional (3D) models from point clouds is complex and time-consuming. In this scenario, semantic segmentation of 3D Point Clouds is gaining more and more attention, since it might help to automatically recognize historical architectural elements. The way paved by recent Deep Learning approaches proved to provide reliable and affordable degrees of automation in other contexts, as road scenes understanding. However, semantic segmentation is particularly challenging in historical and classical architecture, due to the shapes complexity and the limited repeatability of elements across different buildings, which makes it difficult to define common patterns within the same class of elements. Furthermore, as Deep Learning models requires a considerably large amount of annotated data to be trained and tuned to properly handle unseen scenes, the lack of (big) publicly available annotated point clouds in the historical building domain is a huge problem, which in fact blocks the research in this direction. However, creating a critical mass of annotated point clouds by manual annotation is very time-consuming and impractical. To tackle this issue, in this work we explore the idea of leveraging synthetic point cloud data to train Deep Learning models to perform semantic segmentation of point clouds obtained via Terrestrial Laser Scanning. The aim is to provide a first assessment of the use of synthetic data to drive Deep Learning-based semantic segmentation in the context of historical buildings. To achieve this purpose, we present an improved version of the Dynamic Graph CNN (DGCNN) named RadDGCNN. The main improvement consists on exploiting the radius distance. In our experiments, we evaluate the trained models on synthetic dataset (publicly available) about two different historical buildings: the Ducal Palace in Urbino, Italy, and Palazzo Ferretti in Ancona, Italy. RadDGCNN yields good results, demonstrating improved segmentation performances on the TLS real datasets.
引用
收藏
页数:16
相关论文
共 37 条
  • [31] Ros G., 2016, Proceedings of the IEEE conference on computer vision and pattern recognition, P3234, DOI DOI 10.1109/CVPR.2016.352
  • [32] Tran Ha, 2019, Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci., V42, P889, DOI [10.5194/isprs-archives-XLII-2-W13-889-2019, DOI 10.5194/ISPRS-ARCHIVES-XLII-2-W13-889-2019]
  • [33] Automatic Generation of Synthetic LiDAR Point Clouds for 3-D Data Analysis
    Wang, Fei
    Zhuang, Yan
    Gu, Hong
    Hu, Huosheng
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (07) : 2671 - 2673
  • [34] Wang T, 2012, INT C PATT RECOG, P3304
  • [35] Dynamic Graph CNN for Learning on Point Clouds
    Wang, Yue
    Sun, Yongbin
    Liu, Ziwei
    Sarma, Sanjay E.
    Bronstein, Michael M.
    Solomon, Justin M.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (05):
  • [36] Wu BC, 2019, IEEE INT CONF ROBOT, P4376, DOI [10.1109/ICRA.2019.8793495, 10.1109/icra.2019.8793495]
  • [37] Deep Image-Based Relighting from Optimal Sparse Samples
    Xu, Zexiang
    Sunkavalli, Kalyan
    Hadap, Sunil
    Ramamoorthi, Ravi
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04):