Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning

被引:0
作者
Huang, Shuowen [1 ]
Hu, Qingwu [1 ]
Ai, Mingyao [1 ]
Zhao, Pengcheng [1 ]
Li, Jian [2 ]
Cui, Hao [2 ]
Wang, Shaohua [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Zhengzhou Univ, Sch Geosci & Technol, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Architectural heritage; 3D semantic segmentation; Weakly supervised;
D O I
10.1016/j.autcon.2024.105831
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Point cloud semantic segmentation is significant for managing and protecting architectural heritage. Currently, fully supervised methods require a large amount of annotated data, while weakly supervised methods are difficult to transfer directly to architectural heritage. This paper proposes an end-to-end teacher-guided consistency and contrastive learning weakly supervised (TCCWS) framework for architectural heritage point cloud semantic segmentation, which can fully utilize limited labeled points to train network. Specifically, a teacherstudent framework is designed to generate pseudo labels and a pseudo label dividing module is proposed to distinguish reliable and ambiguous point sets. Based on it, a consistency and contrastive learning strategy is designed to fully utilize supervision signals to learn the features of point clouds. The framework is tested on the ArCH dataset and self-collected point cloud, which demonstrates that the proposed method can achieve effective semantic segmentation of architectural heritage using only 0.1 % of annotated points.
引用
收藏
页数:14
相关论文
共 33 条
  • [11] HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation via Hybrid Contrastive Regularization
    Li, Mengtian
    Xie, Yuan
    Shen, Yunhang
    Ke, Bo
    Qiao, Ruizhi
    Ren, Bo
    Lin, Shaohui
    Ma, Lizhuang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14910 - 14919
  • [12] Meta Architecture for Point Cloud Analysis
    Lin, Haojia
    Zheng, Xiawu
    Li, Lijiang
    Chao, Fei
    Wang, Shanshan
    Wang, Yan
    Tian, Yonghong
    Ji, Rongrong
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17682 - 17691
  • [13] One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation
    Liu, Zhengzhe
    Qi, Xiaojuan
    Fu, Chi-Wing
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1726 - 1736
  • [14] Matrone F., 2020, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLIII-B2-2020, P1419, DOI [DOI 10.5194/ISPRS-ARCHIVES-XLIII-B2-2020-1419-2020, 10.5194/isprs-archives-XLIII-B2-2020-1419-2020]
  • [15] Comparing Machine and Deep Learning Methods for Large 3D Heritage Semantic Segmentation
    Matrone, Francesca
    Grilli, Eleonora
    Martini, Massimo
    Paolanti, Marina
    Pierdicca, Roberto
    Remondino, Fabio
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (09)
  • [16] Operability of Point Cloud Data in an Architectural Heritage Information Model
    Moyano, Juan
    Nieto-Julian, Juan E.
    Lenin, Lara M.
    Bruno, Silvana
    [J]. INTERNATIONAL JOURNAL OF ARCHITECTURAL HERITAGE, 2022, 16 (10) : 1588 - 1607
  • [17] Self-positioning Point-based Transformer for Point Cloud Understanding
    Park, Jinyoung
    Lee, Sanghyeok
    Kim, Sihyeon
    Xiong, Yunyang
    Kim, Hyunwoo J.
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21814 - 21823
  • [18] Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage
    Pierdicca, Roberto
    Paolanti, Marina
    Matrone, Francesca
    Martini, Massimo
    Morbidoni, Christian
    Malinverni, Eva Savina
    Frontoni, Emanuele
    Lingua, Andrea Maria
    [J]. REMOTE SENSING, 2020, 12 (06)
  • [19] Qi C.R., 2017, Advances in Neural Information Processing Systems, P5105
  • [20] PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
    Qi, Charles R.
    Su, Hao
    Mo, Kaichun
    Guibas, Leonidas J.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 77 - 85