Large-scale 3D point-cloud semantic segmentation of urban and rural scenes using data volume decomposition coupled with pipeline parallelism

被引:20
作者
Chew, Alvin Wei Ze [1 ]
Ji, Ankang [2 ,3 ]
Zhang, Limao [3 ]
机构
[1] Bentley Syst Res Off, 1 Harbourfront Pl,HarbourFront Tower One, Singapore 098633, Singapore
[2] Harbin Inst Technol, Sch Management, Harbin 150001, Peoples R China
[3] Nanyang Technol Univ, Sch Civil & Environm Engn, 50 Nanyang Ave, Singapore 639798, Singapore
关键词
Deep learning; Image segmentation analysis; Encoder-decoder; Pipeline parallelism; 3D point-cloud data; EMPIRICAL MODE DECOMPOSITION; CRACK DETECTION; CLASSIFICATION; NETWORK; OBJECTS;
D O I
10.1016/j.autcon.2021.103995
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This study proposes a generic approach which performs a series of systematic analyses by first introducing a data volume decomposition method to generate useful data features for performing semantic segmentation analysis involving 3D point-cloud data. Pipeline parallelism protocol is then implemented to accelerate the deep learning model's training phase. Our proposed approach is verified by decomposing around 2.0 billion point-cloud data points, as extracted from an open-source Semantic3D dataset, into many 3D regular structures with defined numbers of voxels. Each derived 3D structure has imposed normality in their data distribution of the respective label classes. Using the optimal hyperparameters for model training, the resulting trained model achieves average overall accuracy (mOA) and average intersection over union (mIOU) values of 0.984 and 0.752, respectively, on a testing dataset having close to 800 million point-cloud data points. The results are comparable with that of other state-of-the-art models in the literature.
引用
收藏
页数:19
相关论文
共 88 条
[21]   Point attention network for semantic segmentation of 3D point clouds [J].
Feng, Mingtao ;
Zhang, Liang ;
Lin, Xuefei ;
Gilani, Syed Zulqarnain ;
Mian, Ajmal .
PATTERN RECOGNITION, 2020, 107
[22]   ThickSeg: Efficient semantic segmentation of large-scale 3D point clouds using multi-layer projection [J].
Gao, Qian ;
Shen, Xukun .
IMAGE AND VISION COMPUTING, 2021, 108
[23]   3D Semantic Segmentation with Submanifold Sparse Convolutional Networks [J].
Graham, Benjamin ;
Engelcke, Martin ;
van der Maaten, Laurens .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9224-9232
[24]   Rock: A robust clustering algorithm for categorical attributes [J].
Guha, S ;
Rastogi, R ;
Shim, K .
INFORMATION SYSTEMS, 2000, 25 (05) :345-366
[25]  
Guo YL, 2013, INT C COMM SIG PROC
[26]  
Hackel T., 2017, ISPRS, V4, P91, DOI DOI 10.5194/ISPRS-ANNALS-IV-1-W1-91-2017
[27]   Sewer Defect Classification using Synthetic Point Clouds [J].
Haurum, Joakim Bruslund ;
Allahham, Moaaz M. J. ;
Lynge, Mathias S. ;
Henriksen, Kasper Schon ;
Nikolov, Ivan A. ;
Moeslund, Thomas B. .
VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, :891-900
[28]   PIG-Net: Inception based deep learning architecture for 3D point cloud segmentation * [J].
Hegde, Sindhu ;
Gangisetty, Shankar .
COMPUTERS & GRAPHICS-UK, 2021, 95 :13-22
[29]  
Heinlein A., 2021, GAMM MITTEILUNGEN, V44, DOI [10.1002/gamm.202100001e202100001, DOI 10.1002/GAMM.202100001E202100001]
[30]   Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing [J].
Hu, Shi-Min ;
Cai, Jun-Xiong ;
Lai, Yu-Kun .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (07) :2485-2498