Automated 3D defect inspection in shield tunnel linings through integration of image and point cloud data

被引:0
作者
Hongwei Huang [1 ]
Shuyi Liu [1 ]
Mingliang Zhou [1 ]
Hua Shao [2 ]
Qingtong Li [3 ]
Phromphat Thansirichaisree [4 ]
机构
[1] Key Laboratory of Geotechnical and Underground Engineering of Ministry of Education and Department of Geotechnical Engineering, Tongji University, Shanghai
[2] Shanghai Metro Maintenance Co., Ltd., Shanghai
[3] Shanghai Shentong Metro Group Co., Ltd., Shanghai
[4] Thammasat School of Engineering, Thammasat University Rangsit, Klong Luang, Pathumthani
来源
AI in Civil Engineering | 2025年 / 4卷 / 1期
关键词
3D reconstruction; Automated inspection; Image segmentation; Point cloud; Tunnel defect;
D O I
10.1007/s43503-025-00054-w
中图分类号
学科分类号
摘要
Recent advancements in automated tunnel defect detection have utilized high-resolution cameras and mobile laser scanners. However, the inability of cameras to accurately capture 3D spatial coordinates complicates tasks such as 3D visualization, while the relatively low resolution of laser scanners makes it difficult to detect small defects such as microcracks. In this paper, a comprehensive inspection method is proposed to address these limitations by integrating multi-defect detection, 3D coordinate acquisition, and visualization. The inspection process involves the capture of both image data and point cloud data of tunnel linings using the newly developed inspection cart (MTI-300). The proposed fusion approach combines image and point cloud data, leveraging the enhanced YOLOv8-seg instance segmentation model for defect identification. The scale-invariant feature transform (SIFT) algorithm is used to match local defect regions in the image data with the corresponding point cloud data, enabling the extraction of 3D coordinates and the integration of defect pixels with the point cloud information. Subsequently, a lightweight 3D reconstruction model is developed to visualize the entire tunnel and its defects using the fused data. The performance of the proposed method is validated and substantiated through a field experiment on Metro Line 8 in Qingdao, China. © The Author(s) 2025.
引用
收藏
相关论文
共 65 条
[1]  
Alparone L., Wald L., Chanussot J., Thomas C., Gamba P., Bruce L.M., Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest, IEEE Transactions on Geoscience and Remote Sensing, 45, 10, pp. 3012-3021, (2007)
[2]  
An Y., Li B., Wang L., Zhang C., Zhou X., Calibration of a 3D laser rangefinder and a camera based on optimization solution, Journal of Industrial & Management Optimization, (2021)
[3]  
Bay H., Ess A., Tuytelaars T., Van Gool L., Speeded-up robust features (SURF), Computer Vision and Image Understanding, 110, 3, pp. 346-359, (2008)
[4]  
Cai H., Pang W., Chen X., Wang Y., Liang H., A novel calibration board and experiments for 3D LiDAR and camera calibration, Sensors, 20, 4, (2020)
[5]  
Cai Z., Vasconcelos N., Cascade R-CNN: High quality object detection and instance segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 43, 5, pp. 1483-1498, (2019)
[6]  
Carion N., Massa F., Synnaeve G., Usunier N., Kirillov A., Zagoruyko S., End-to-end object detection with transformers, (2020)
[7]  
Cheng B., Misra I., Schwing A.G., Kirillov A., Girdhar R., Masked-attention mask transformer for universal image segmentation, In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1290-1299, (2022)
[8]  
Cheng X., Hu X., Tan K., Wang L., Yang L., Automatic detection of shield tunnel leakages based on terrestrial mobile LiDAR intensity images using deep learning, IEEE Access, 9, pp. 55300-55310, (2021)
[9]  
Chu X., Tang L., Sun F., Chen X., Niu L., Ren C., Li Q., Defect detection for a vertical shaft surface based on multimodal sensors, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, pp. 8109-8117, (2022)
[10]  
Cui H., Mao Q., Li J., Hu Q., Tao Y., Ma J., Li Z., Shield Tunnel Dislocation Detection Method Based on semantic segmentation and bolt hole positioning of MLS point cloud, IEEE Transactions on Geoscience and Remote Sensing, (2024)