Dual attention-based deep learning network for multi-class object semantic segmentation of tunnel point clouds

被引:18
作者
Ji, Ankang [1 ,2 ]
Zhang, Limao [3 ]
Fan, Hongqin [1 ]
Xue, Xiaolong [4 ]
Dou, Yudan [5 ]
机构
[1] Hong Kong Polytech Univ, Dept Bldg & Real Estate, Hong Kong 999077, Peoples R China
[2] Hong Kong Polytech Univ, Shenzhen Res Inst, Shenzhen 518057, Guangdong, Peoples R China
[3] Huazhong Univ Sci & Technol, Natl Ctr Technol Innovat Digital Construct, Sch Civil & Hydraul Engn, Wuhan 430074, Peoples R China
[4] Guangzhou Univ, Sch Management, Guangzhou 510006, Guangdong, Peoples R China
[5] Dalian Univ Technol, Dept Construct Management, Dalian 116024, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Semantic segmentation; Tunnel point cloud; Encoder-decoder; 3D dual attention module; CRACK DETECTION;
D O I
10.1016/j.autcon.2023.105131
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Aiming to automatically segment multi-class objects on the tunnel point cloud, a deep learning network named dual attention-based point cloud network (DAPCNet) is developed in this paper to act on point clouds for segmentation. In the developed model, data normalization and feature aggregation are first processed to eliminate data discrepancies and enhance local features, after which the processed data are input into the built network layers based on the encoder-decoder architecture coupled with an improved 3D dual attention module to extract and learn features. Furthermore, a custom loss function called Facal Cross-Entropy ("FacalCE") is designed to enhance the model's ability to extract and learn features while addressing imbalanced data distribution. To validate the effectiveness and feasibility of the developed model, a dataset of tunnel point clouds collected from a real engineering project in China is employed. The experimental results indicate that (1) the developed model has excellent performance with Mean Intersection over Union (MIoU) of 0.8597, (2) the improved 3D dual attention module and "FacalCE" contribute to the model performance, respectively, and (3) the developed model is superior to other state-of-the-art methods, such as PointNet and DGCNN. In summary, the DAPCNet model exhibits exceptional performance, offering effective and accurate results for segmenting multi-class objects within tunnel point clouds.
引用
收藏
页数:16
相关论文
共 63 条
[1]   Attention-based generative adversarial network with internal damage segmentation using thermography [J].
Ali, Rahmat ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2022, 141
[2]   Fragility of transport assets exposed to multiple hazards: State-of-the-art review toward infrastructural resilience [J].
Argyroudis, Sotirios A. ;
Mitoulis, Stergios A. ;
Winter, Mike G. ;
Kaynia, Amir M. .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2019, 191
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]   Encoder-decoder network for pixel-level road crack detection in black-box images [J].
Bang, Seongdeok ;
Park, Somin ;
Kim, Hongjo ;
Kim, Hyoungkwan .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2019, 34 (08) :713-727
[5]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]   3D Photogrammetry Point Cloud Segmentation Using a Model Ensembling Framework [J].
Chen, Meida ;
Feng, Andrew ;
McCullough, Kyle ;
Prasad, Pratusha Bhuvana ;
McAlinden, Ryan ;
Soibelman, Lucio .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2020, 34 (06)
[8]   Automatic creation of as-is building information model from single-track railway tunnel point clouds [J].
Cheng, Yun-Jian ;
Qiu, Wen-Ge ;
Duan, Dong-Ya .
AUTOMATION IN CONSTRUCTION, 2019, 106
[9]   Large-scale 3D point-cloud semantic segmentation of urban and rural scenes using data volume decomposition coupled with pipeline parallelism [J].
Chew, Alvin Wei Ze ;
Ji, Ankang ;
Zhang, Limao .
AUTOMATION IN CONSTRUCTION, 2022, 133
[10]   Tiny-Crack-Net: A multiscale feature fusion network with attention mechanisms for segmentation of tiny cracks [J].
Chu, Honghu ;
Wang, Wei ;
Deng, Lu .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2022, 37 (14) :1914-1931