Automatic Detection Method of Sewer Pipe Defects Using Deep Learning Techniques

被引:8
作者
Zhang, Jiawei [1 ]
Liu, Xiang [1 ]
Zhang, Xing [2 ]
Xi, Zhenghao [1 ]
Wang, Shuohong [3 ,4 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Jiangsu Univ, Automot Engn Res Inst, Zhenjiang 212013, Peoples R China
[3] Harvard Univ, Dept Mol & Cellular Biol, Cambridge, MA 02138 USA
[4] Harvard Univ, Ctr Brain Sci, Cambridge, MA 02138 USA
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 07期
关键词
sewer inspection; CCTV; spatial pyramid pooling; DIoU; YOLOv4; CLASSIFICATION; NETWORKS;
D O I
10.3390/app13074589
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Regular inspection of sewer pipes can detect serious defects in time, which is significant to ensure the healthy operation of sewer systems and urban safety. Currently, the widely used closed-circuit television (CCTV) inspection system relies mainly on manual assessment, which is labor intensive and inefficient. Therefore, it is urgent to develop an efficient and accurate automatic defect detection method. In this paper, an improved method based on YOLOv4 is proposed for the detection of sewer defects. A significant improvement of this method is using the spatial pyramid pooling (SPP) module to expand the receptive field and improve the ability of the model to fuse context features in different receptive fields. Meanwhile, the influence of three bounding box loss functions on model performance are compared based on their processing speed and detection accuracy, and the effectiveness of the combination of DIoU loss function and SPP module is verified. In addition, to address the lack of datasets for sewer defect detection, a dataset that contains 2700 images and 4 types of defects was created, which provides useful help for the application of computer vision techniques in this field. Experimental results show that, compared with the YOLOv4 model, the mean average precision (mAP) of the improved model for sewer defect detection are improved by 4.6%, the mAP can reach 92.3% and the recall can reach 89.0%. The improved model can effectively improve the detection and classification accuracy of sewer defects, and has significant advantages compared with other methods.
引用
收藏
页数:19
相关论文
共 31 条
  • [1] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [2] Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques
    Cheng, Jack C. P.
    Wang, Mingzhu
    [J]. AUTOMATION IN CONSTRUCTION, 2018, 95 : 155 - 171
  • [3] Rich feature hierarchies for accurate object detection and semantic segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 580 - 587
  • [4] Automated defect detection in sewer closed circuit television images using histograms of oriented gradients and support vector machine
    Halfawy, Mahmoud R.
    Hengmeechai, Jantira
    [J]. AUTOMATION IN CONSTRUCTION, 2014, 38 : 1 - 13
  • [5] Sewer-ML: A Multi-Label Sewer Defect Classification Dataset and Benchmark
    Haurum, Joakim Bruslund
    Moeslund, Thomas B.
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13451 - 13462
  • [6] A Survey on Image-Based Automation of CCTV and SSET Sewer Inspections
    Haurum, Joakim Bruslund
    Moeslund, Thomas B.
    [J]. AUTOMATION IN CONSTRUCTION, 2020, 111 (111)
  • [7] Automated defect detection tool for closed circuit television (cctv) inspected sewer pipelines
    Hawari, Alaa
    Alamin, Mazen
    Alkadour, Firas
    Elmasry, Mohamed
    Zayed, Tarek
    [J]. AUTOMATION IN CONSTRUCTION, 2018, 89 : 99 - 109
  • [8] Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) : 1904 - 1916
  • [9] Current state and future perspectives of sewer networks in urban China
    Huang, Dong
    Liu, Xiuhong
    Jiang, Songzhu
    Wang, Hongchen
    Wang, Junyan
    Zhang, Yuankai
    [J]. FRONTIERS OF ENVIRONMENTAL SCIENCE & ENGINEERING, 2018, 12 (03)
  • [10] Quantification of visual blockage at culverts using deep learning based computer vision models
    Iqbal, Umair
    Bin Riaz, Muhammad Zain
    Barthelemy, Johan
    Perez, Pascal
    [J]. URBAN WATER JOURNAL, 2023, 20 (01) : 26 - 38