Segmentation of large-scale masonry arch bridge point clouds with a synthetic simulator and the BridgeNet neural network

被引:46
作者
Jing, Yixiong [1 ]
Sheil, Brian [1 ]
Acikgoz, Sinan [1 ]
机构
[1] Univ Oxford, Dept Engn Sci, Parks Rd, Oxford OX1 3PJ, England
关键词
Masonry arch bridge; Deep learning; BridgeNet; Synthetic dataset; Semantic segmentation; Geometric feature extraction;
D O I
10.1016/j.autcon.2022.104459
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Masonry arch bridges constitute the majority of the European bridge stock and feature a wide range of geometric characteristics. Due to a general lack of construction drawings, their geometry is difficult to parameterize. Laser scanning devices are commonly used to capture bridge geometry. However, this requires time-consuming segmentation of point clouds into their constituent components to extract key geometric parameters. To increase efficiency, a 3D deep learning neural network called BridgeNet is proposed that can automate the segmentation. To tackle the scarcity of labelled point cloud data, a synthetic dataset is created to train BridgeNet. BridgeNet is subsequently tested on real point clouds and achieves state-of-art performance, demonstrating the utility of synthetic training data and the advantages of the new network design. Segmented components are then fitted with primitive shapes by using Random Sample Consensus based algorithms to characterize key geometric parameters to assist assessments and inspections.
引用
收藏
页数:13
相关论文
共 59 条
[41]   Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs [J].
Simonovsky, Martin ;
Komodakis, Nikos .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :29-38
[42]   A Hierarchical Machine Learning Approach for Multi-Level and Multi-Resolution 3D Point Cloud Classification [J].
Teruggi, Simone ;
Grilli, Eleonora ;
Russo, Michele ;
Fassi, Francesco ;
Remondino, Fabio .
REMOTE SENSING, 2020, 12 (16)
[43]   KPConv: Flexible and Deformable Convolution for Point Clouds [J].
Thomas, Hugues ;
Qi, Charles R. ;
Deschaud, Jean-Emmanuel ;
Marcotegui, Beatriz ;
Goulette, Francois ;
Guibas, Leonidas J. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6420-6429
[44]   Automated defect detection and classification in ashlar masonry walls using machine learning [J].
Valero, Enrique ;
Forster, Alan ;
Bosche, Frederic ;
Hyslop, Ewan ;
Wilson, Lyn ;
Turmel, Aurelie .
AUTOMATION IN CONSTRUCTION, 2019, 106
[45]   Graph Attention Convolution for Point Cloud Semantic Segmentation [J].
Wang, Lei ;
Huang, Yuchun ;
Hou, Yaolin ;
Zhang, Shenman ;
Shan, Jie .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10288-10297
[46]   SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation [J].
Wang, Weiyue ;
Yu, Ronald ;
Huang, Qiangui ;
Neumann, Ulrich .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2569-2578
[47]   Dynamic Graph CNN for Learning on Point Clouds [J].
Wang, Yue ;
Sun, Yongbin ;
Liu, Ziwei ;
Sarma, Sanjay E. ;
Bronstein, Michael M. ;
Solomon, Justin M. .
ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (05)
[48]   Semantic segmentation of point clouds of building interiors with deep learning: Augmenting training datasets with synthetic BIM-based point clouds [J].
Won, Jong ;
Czerniawski, Thomas ;
Leite, Fernanda .
AUTOMATION IN CONSTRUCTION, 2020, 113
[49]  
Wu BC, 2019, IEEE INT CONF ROBOT, P4376, DOI [10.1109/icra.2019.8793495, 10.1109/ICRA.2019.8793495]
[50]  
Wu BC, 2018, IEEE INT CONF ROBOT, P1887