Automatic sewer pipe defect semantic segmentation based on improved U-Net

被引:79
作者
Pan, Gang [1 ]
Zheng, Yaoxian [1 ]
Guo, Shuai [2 ]
Lv, Yaozhi [3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Hefei Univ Technol, Dept Municipal Engn, Hefei, Anhui, Peoples R China
[3] Tianjin Municipal Engn Design & Res Inst, Key Lab Infrastruct Durabil, Tianjin, Peoples R China
关键词
Sewer inspection; Semantic segmentation; Deep learning; U-Net closed-circuit television; IMAGE;
D O I
10.1016/j.autcon.2020.103383
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
At present, technologies based on deep learning methods for automated detection of sewer defects have been developing rapidly. In this study, a novel semantic segmentation network called PipeUNet is proposed for sewer defect segmentation. In order to enhance the feature extraction capability and resolve semantic differences between high level and low level features, a new module named feature reuse and attention mechanism block is added between the original skip connections of U-Net. Focal loss is adopted to solve the class imbalance problem. PipeUNet was trained using the CCTV images with typical defects including crack, infiltration, joint offset and intruding lateral. It was tested by the defects images and normal images to evaluate the network's defect segmentation and detection performance respectively. It achieved the highest Mean Intersection over Union of 76.37% which proved the proposed approach's efficiency. It can process CCTV images at a high speed of 32 images per second.
引用
收藏
页数:12
相关论文
共 44 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[3]   Neuro-fuzzy approaches for sanitary sewer pipeline condition assessment [J].
Chae, MJ ;
Abraham, DM .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2001, 15 (01) :4-14
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]   Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques [J].
Cheng, Jack C. P. ;
Wang, Mingzhu .
AUTOMATION IN CONSTRUCTION, 2018, 95 :155-171
[6]  
Deboda T., 2015, TECHNICIAN BENEFITS, P878, DOI [10.1061/9780784479360, DOI 10.1061/9780784479360]
[7]   A survey on deep learning techniques for image and video semantic segmentation [J].
Garcia-Garcia, Alberto ;
Orts-Escolano, Sergio ;
Oprea, Sergiu ;
Villena-Martinez, Victor ;
Martinez-Gonzalez, Pablo ;
Garcia-Rodriguez, Jose .
APPLIED SOFT COMPUTING, 2018, 70 :41-65
[8]   Efficient Algorithm for Crack Detection in Sewer Images from Closed-Circuit Television Inspections [J].
Halfawy, Mahmoud R. ;
Hengmeechai, Jantira .
JOURNAL OF INFRASTRUCTURE SYSTEMS, 2014, 20 (02)
[9]   Crack Automatic Detection of CCTV Video of Sewer Inspection with Low Resolution [J].
Heo, Gwanghee ;
Jeon, Joonryong ;
Son, Byungjik .
KSCE JOURNAL OF CIVIL ENGINEERING, 2019, 23 (03) :1219-1227
[10]  
Hertzberg J, 1998, FROM ANIM ANIMAT, P427