Improving Sewer Damage Inspection: Development of a Deep Learning Integration Concept for a Multi-Sensor System

被引:2
作者
Jung, Jan Thomas [1 ,2 ]
Reiterer, Alexander [1 ,2 ]
机构
[1] Univ Freiburg, Dept Sustainable Syst Engn, Georges Kohler Allee 10, D-79110 Freiburg, Germany
[2] Fraunhofer Inst Phys Measurement Tech IPM, Georges Kohler Allee 301, D-79110 Freiburg, Germany
关键词
automated inspection; damage detection; sewer pipes; artificial intelligence; robotic inspection; computer vision; urban infrastructure; 3D vision; point cloud; LiDAR;
D O I
10.3390/s24237786
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The maintenance and inspection of sewer pipes are essential to urban infrastructure but remain predominantly manual, resource-intensive, and prone to human error. Advancements in artificial intelligence (AI) and computer vision offer significant potential to automate sewer inspections, improving reliability and reducing costs. However, the existing vision-based inspection robots fail to provide data quality sufficient for training reliable deep learning (DL) models. To address these limitations, we propose a novel multi-sensor robotic system coupled with a DL integration concept. Following a comprehensive review of the current 2D (image) and 3D (point cloud) sewage pipe inspection methods, we identify key limitations and propose a system incorporating a camera array, front camera, and LiDAR sensor to optimise surface capture and enhance data quality. Damage types are assigned to the sensor best suited for their detection and quantification, while tailored DL models are proposed for each sensor type to maximise performance. This approach enables the optimal detection and processing of relevant damage types, achieving higher accuracy for each compared to single-sensor systems.
引用
收藏
页数:32
相关论文
共 82 条
[1]   3D Sensors for Sewer Inspection: A Quantitative Review and Analysis [J].
Bahnsen, Chris H. ;
Johansen, Anders S. ;
Philipsen, Mark P. ;
Henriksen, Jesper W. ;
Nasrollahi, Kamal ;
Moeslund, Thomas B. .
SENSORS, 2021, 21 (07)
[2]  
Biswas R., 2023, P 12 INT C PATT REC, P897, DOI 10.5220/0011709400003411
[3]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[4]  
Chen K, 2019, Arxiv, DOI arXiv:1901.07518
[5]  
Chen LC, 2017, Arxiv, DOI arXiv:1706.05587
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]   Deep Learning Based Underground Sewer Defect Classification Using a Modified RegNet [J].
Chen, Yu ;
Sharifuzzaman, Sagar A. S. M. ;
Wang, Hangxiang ;
Li, Yanfen ;
Dang, L. Minh ;
Song, Hyoung-Kyu ;
Moon, Hyeonjoon .
CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03) :5451-5469
[8]   Lightweight pixel-level semantic segmentation and analysis for sewer defects using deep learning [J].
Dang, L. Minh ;
Wang, Hanxiang ;
Li, Yanfen ;
Nguyen, Le Quan ;
Nguyen, Tan N. ;
Song, Hyoung-Kyu ;
Moon, Hyeonjoon .
CONSTRUCTION AND BUILDING MATERIALS, 2023, 371
[9]   DefectTR: End-to-end defect detection for sewage networks using a transformer [J].
Dang, L. Minh ;
Wang, Hanxiang ;
Li, Yanfen ;
Nguyen, Tan N. ;
Moon, Hyeonjoon .
CONSTRUCTION AND BUILDING MATERIALS, 2022, 325
[10]   Deep learning-based sewer defect classification for highly imbalanced dataset [J].
Dang, L. Minh ;
Kyeong, SeonJae ;
Li, Yanfen ;
Wang, Hanxiang ;
Nguyen, N. Tan ;
Moon, Hyeonjoon .
COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 161