GL-Net: Semantic segmentation for point clouds of shield tunnel via global feature learning and local feature discriminative aggregation

被引:24
作者
Li, Jincheng [1 ,2 ,3 ,4 ]
Zhang, Zhenxin [1 ,2 ,3 ,4 ]
Sun, Haili [1 ,2 ,3 ,4 ]
Xie, Si [5 ]
Zou, Jianjun [1 ,2 ,3 ,4 ]
Ji, Changqi [1 ,2 ,3 ,4 ]
Lu, Yue [1 ,2 ,3 ,4 ]
Ren, Xiaoxu [1 ,2 ,3 ,4 ]
Wang, Liuzhao [1 ,2 ,3 ,4 ]
机构
[1] Capital Normal Univ, Beijing Adv Innovat Ctr Imaging Theory & Technol, Beijing 100048, Peoples R China
[2] Capital Normal Univ, Key Lab 3D Informat Acquisit & Applicat, MOE, Beijing 100048, Peoples R China
[3] Capital Normal Univ, Acad Multidisciplinary Studies, Beijing 100048, Peoples R China
[4] Capital Normal Univ, Coll Resource Environm & Tourism, Beijing 100048, Peoples R China
[5] State Key Lab Rail Transit Engn Informatizat FSDI, Xian 710043, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Semantic segmentation; Shield tunnel; Point clouds; Sample imbalance; Deep learning;
D O I
10.1016/j.isprsjprs.2023.04.011
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
has gradually become the first choice of modern urban public transportation due to its advantages of safety and high-efficiency. Shield tunnel is an important type of subway tunnel, and its structural stability and safety play an important role in subway operation. The shield tunnels are prone to problems such as water leakage and tunnel collapse, which affect the safe operation of subways. Efficient monitoring methods are required to detect the status of subway tunnels. The data collection and accurate segmentation of key components of shield tunnels are the basis and key to the automatic monitoring of subway tunnels. This research presents a novel semantic segmentation method of three-dimensional (3-D) point clouds of typical structural elements (e.g., longitudinal joint, circumferential joints, bolt hole and grouting hole) in shield tunnel based on deep learning. In this method, we focus on how to make the network learn robust global features and complex local distribution patterns. Further, we propose a global and local feature encoding block (namely GL-block) to discriminatively aggregate local features while learning global representation. After multiple encodings by the GL-block, we design a global correlation modeling (GCM) module to establish a global awareness of each point. Finally, a weighted crossentropy loss function is designed to solve the problem of unbalanced number of samples in each category of shield tunnel. In the experiments, we make a dataset of shield tunnel point clouds with a length of about 1,000 m collected by CNU-TS-1 (DU et al., 2018) mobile tunnel monitoring system, and use the dataset to train and test the segmentation ability of our method on the typical structural elements of shield tunnels. Experiments verify the effectiveness of our method by comparing with the other state-of-the-art 3-D point cloud semantic segmentation methods, and our method has an mIoU score of 73.02 %, which is at least 14.54 % higher than the other compared state-of-the-art networks. Also, we further verify the adaptability of our method to different tunnels and different laser scanning equipment, such as FARO, Leica and Z + F, and achieve very advanced performance.
引用
收藏
页码:335 / 349
页数:15
相关论文
共 49 条
[1]  
Ahmad A, 2018, CONF REC ASILOMAR C, P2225, DOI 10.1109/ACSSC.2018.8645256
[2]  
[Anonymous], 2016, Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, DOI DOI 10.1109/CVPR.2016.170
[3]   Tunnel Reconstruction With Block Level Precision by Combining Data-Driven Segmentation and Model-Driven Assembly [J].
Cao, Zhen ;
Chen, Dong ;
Peethambaran, Jiju ;
Zhang, Zhenxin ;
Xia, Shaobo ;
Zhang, Liqiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (10) :8853-8872
[4]   Shield subway tunnel deformation detection based on mobile laser scanning [J].
Cui, Hao ;
Ren, Xiaochun ;
Mao, Qingzhou ;
Hu, Qingwu ;
Wang, Wei .
AUTOMATION IN CONSTRUCTION, 2019, 106
[5]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[6]   Dislocation Detection of Shield Tunnel Based on Dense Cross-Sectional Point Clouds [J].
Du, Liming ;
Zhong, Ruofei ;
Sun, Haili ;
Pang, Yong ;
Mo, You .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :22227-22243
[7]   Study of the Integration of the CNU-TS-1 Mobile Tunnel Monitoring System [J].
Du, Liming ;
Zhong, Ruofei ;
Sun, Haili ;
Zhu, Qiang ;
Zhang, Zhen .
SENSORS, 2018, 18 (02)
[8]   Point Transformer [J].
Engel, Nico ;
Belagiannis, Vasileios ;
Dietmayer, Klaus .
IEEE ACCESS, 2021, 9 :134826-134840
[9]   SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation [J].
Fan, Siqi ;
Dong, Qiulei ;
Zhu, Fenghua ;
Lv, Yisheng ;
Ye, Peijun ;
Wang, Fei-Yue .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14499-14508
[10]   Deep Multitask Learning for Railway Track Inspection [J].
Gibert, Xavier ;
Patel, VishalM. ;
Chellappa, Rama .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (01) :153-164