Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning

被引:0
作者
Huang, Shuowen [1 ]
Hu, Qingwu [1 ]
Ai, Mingyao [1 ]
Zhao, Pengcheng [1 ]
Li, Jian [2 ]
Cui, Hao [2 ]
Wang, Shaohua [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Zhengzhou Univ, Sch Geosci & Technol, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud; Architectural heritage; 3D semantic segmentation; Weakly supervised;
D O I
10.1016/j.autcon.2024.105831
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Point cloud semantic segmentation is significant for managing and protecting architectural heritage. Currently, fully supervised methods require a large amount of annotated data, while weakly supervised methods are difficult to transfer directly to architectural heritage. This paper proposes an end-to-end teacher-guided consistency and contrastive learning weakly supervised (TCCWS) framework for architectural heritage point cloud semantic segmentation, which can fully utilize limited labeled points to train network. Specifically, a teacherstudent framework is designed to generate pseudo labels and a pseudo label dividing module is proposed to distinguish reliable and ambiguous point sets. Based on it, a consistency and contrastive learning strategy is designed to fully utilize supervision signals to learn the features of point clouds. The framework is tested on the ArCH dataset and self-collected point cloud, which demonstrates that the proposed method can achieve effective semantic segmentation of architectural heritage using only 0.1 % of annotated points.
引用
收藏
页数:14
相关论文
共 33 条
  • [1] Armeni Iro, 2017, ARXIV
  • [2] Automatic generation of synthetic heritage point clouds: Analysis and segmentation based on shape grammar for historical vaults
    Battini, Carlo
    Ferretti, Umberto
    De Angelis, Giorgia
    Pierdicca, Roberto
    Paolanti, Marina
    Quattrini, Ramona
    [J]. JOURNAL OF CULTURAL HERITAGE, 2024, 66 : 37 - 47
  • [3] Shield subway tunnel deformation detection based on mobile laser scanning
    Cui, Hao
    Ren, Xiaochun
    Mao, Qingzhou
    Hu, Qingwu
    Wang, Wei
    [J]. AUTOMATION IN CONSTRUCTION, 2019, 106
  • [4] ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
    Dai, Angela
    Chang, Angel X.
    Savva, Manolis
    Halber, Maciej
    Funkhouser, Thomas
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2432 - 2443
  • [5] SVD-based point cloud 3D stone by stone segmentation for cultural heritage structural analysis-The case of the Apollo Temple at Delphi
    Galanakis, Demitrios
    Maravelakis, Emmanuel
    Pocobelli, Danae Phaedra
    Vidakis, Nectarios
    Petousis, Markos
    Konstantaras, Antonios
    Tsakoumaki, Marilena
    [J]. JOURNAL OF CULTURAL HERITAGE, 2023, 61 : 177 - 187
  • [6] Implementing PointNet for point cloud segmentation in the heritage context
    Haznedar, Bulent
    Bayraktar, Rabia
    Ozturk, Ali Emre
    Arayici, Yusuf
    [J]. HERITAGE SCIENCE, 2023, 11 (01)
  • [7] SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Clouds
    Hu, Qingyong
    Yang, Bo
    Fang, Guangchi
    Guo, Yulan
    Leonardis, Ales
    Trigoni, Niki
    Markham, Andrew
    [J]. COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 600 - 619
  • [8] Hu QY, 2020, PROC CVPR IEEE, P11105, DOI 10.1109/CVPR42600.2020.01112
  • [9] Ji Y., 2021, Int Arch Photogramm Remote Sens Spat Inf Sci, V46, P321, DOI [10.5194/isprs-archives-XLVI-M-1-2021-321-2021, DOI 10.5194/ISPRS-ARCHIVES-XLVI-M-1-2021-321-2021]
  • [10] Segment Anything
    Kirillov, Alexander
    Mintun, Eric
    Ravi, Nikhila
    Mao, Hanzi
    Rolland, Chloe
    Gustafson, Laura
    Xiao, Tete
    Whitehead, Spencer
    Berg, Alexander C.
    Lo, Wan-Yen
    Dolla'r, Piotr
    Girshick, Ross
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3992 - 4003