Self-Supervised Pre-Training for 3-D Roof Reconstruction on LiDAR Data

被引:3
作者
Yang, Hongxin [1 ]
Huang, Shangfeng [1 ]
Wang, Ruisheng [1 ,2 ]
Wang, Xin [1 ]
机构
[1] Univ Calgary, Dept Geomatics Engn, Calgary, AB T2N 1N4, Canada
[2] Shenzhen Univ, Sch Architecture & Urban Planning, Shenzhen 518060, Peoples R China
关键词
Corner detection; Training; Task analysis; edge prediction; roof reconstruction; self-supervised learning;
D O I
10.1109/LGRS.2024.3362733
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Reconstructing building roofs from light detection and ranging (LiDAR) point clouds from aerial perspectives is significantly important in photogrammetry domains. This letter proposes a novel approach for 3-D real-world building roof reconstruction in Estonia, employing a two-stage self-supervised pre-training architecture to transform 3-D roof point clouds into wireframe models. We utilize a self-supervised pre-training framework that incorporates a purpose-designed and efficient self-attention mechanism to generate point-wise features. Subsequently, we develop modules for corner detection and edge prediction to classify and regress the coordinates of corner points and determine optimal edge selections, respectively, to construct the final wireframe model. The effectiveness of our approach is evaluated on real-world roof datasets, achieving corner and edge precision accuracies of 83% and 78%, respectively. In addition, fine-tuning our self-supervised pre-training method with varying ratios of labeled data, particularly with only 50% partially labeled data, attains superior performance, achieving 84% and 85% corner and edge precision, respectively.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 27 条
[1]   DGCNN: A convolutional neural network over large-scale labeled graphs [J].
Anh Viet Phan ;
Minh Le Nguyen ;
Yen Lam Hoang Nguyen ;
Lam Thu Bui .
NEURAL NETWORKS, 2018, 108 :533-543
[2]   Kinetic Shape Reconstruction [J].
Bauchet, Jean-Philippe ;
Lafarge, Florent .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (05)
[3]   Optimum design of chamfer distance transforms [J].
Butt, MA ;
Maragos, P .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (10) :1477-1484
[4]   Topologically Aware Building Rooftop Reconstruction From Airborne Laser Scanning Point Clouds [J].
Chen, Dong ;
Wang, Ruisheng ;
Peethambaran, Jiju .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (12) :7032-7052
[5]   Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks [J].
Feng, Zhen-Hua ;
Kittler, Josef ;
Awais, Muhammad ;
Huber, Patrik ;
Wu, Xiao-Jun .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2235-2245
[6]  
Guo Z., 2023, PROC 32 INT JOINT C, P27061
[7]   City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds [J].
Huang, Jin ;
Stoter, Jantien ;
Peters, Ravi ;
Nan, Liangliang .
REMOTE SENSING, 2022, 14 (09)
[8]   Extracting 3-D Structural Lines of Building From ALS Point Clouds Using Graph Neural Network Embedded With Corner Information [J].
Jiang, Tengping ;
Wang, Yongjun ;
Zhang, Zequn ;
Liu, Shan ;
Dai, Lei ;
Yang, Yongchao ;
Jin, Xin ;
Zeng, Wenjun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[9]   Stratified Transformer for 3D Point Cloud Segmentation [J].
Lai, Xin ;
Liu, Jianhui ;
Jiang, Li ;
Wang, Liwei ;
Zhao, Hengshuang ;
Liu, Shu ;
Qi, Xiaojuan ;
Jia, Jiaya .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :8490-8499
[10]   Point2Roof: End-to-end 3D building roof modeling from airborne LiDAR point clouds [J].
Li, Li ;
Song, Nan ;
Sun, Fei ;
Liu, Xinyi ;
Wang, Ruisheng ;
Yao, Jian ;
Cao, Shaosheng .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 193 :17-28