Underground sewer pipe condition assessment based on convolutional neural networks

被引:132
作者
Hassan, Syed Ibrahim [1 ]
Dang, L. Minh [1 ]
Mehmood, Irfan [1 ]
Im, Suhyeon [1 ]
Choi, Changho [2 ]
Kang, Jaemo [2 ]
Park, Young-Soo [2 ]
Moon, Hyeonjoon [1 ]
机构
[1] Sejong Univ, Dept Comp Sci & Engn, Seoul, South Korea
[2] Korea Inst Civil Engn & Bldg Technol KICT, Ilsan, South Korea
关键词
Deep learning; Closed circuit television (CCTV); Convolutional neural network; Automation; Sewer assessment; Text recognition; Maximally Stable Extremal Regions (MSER); AUTOMATED DETECTION; DEFECT DETECTION; CLASSIFICATION; SEGMENTATION; RECOGNITION;
D O I
10.1016/j.autcon.2019.102849
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
y Surveys for assessing the condition of sewer pipeline systems are mainly based on video surveillance or CCTV, which is a time-consuming process that relies heavily on human labor because an operator has to watch videos, looks for defects and decides the defect's type manually. Previous research required suitable handcrafted features that were inefficient in analyzing sewer pipeline condition, so a robust and efficient framework is crucial as it eliminates the time-consuming tasks and helps the operator access condition of sewer systems more efficiently. This study proposes a defect classification system on CCTV inspection videos based on convolutional neural networks (CNN). The dataset was manually constructed and validated by extracting the images from CCTV videos, and the images were labeled according to six predefined defects. The CNN model was fine-tuned before training, and trained on a total of 47,072 images (256 x 256 pixels). The highest recorded accuracy was at 96.33%. As a result, the presented framework will motivate the finding of a more robust model that automatically and precisely evaluates the condition of sewer pipeline systems using CCTV and encourages the integration of the proposed model in real applications.
引用
收藏
页数:12
相关论文
共 38 条
[1]  
[Anonymous], 2017, ARXIV170709725
[2]  
[Anonymous], 2014, PROC IEEE C COMPUTER, DOI DOI 10.1109/CVPR.2014.81
[3]  
Arevalo J, 2015, IEEE ENG MED BIO, P797, DOI 10.1109/EMBC.2015.7318482
[4]   Deep learning with non-medical training used for chest pathology identification [J].
Bar, Yaniv ;
Diamant, Idit ;
Wolf, Lior ;
Greenspan, Hayit .
MEDICAL IMAGING 2015: COMPUTER-AIDED DIAGNOSIS, 2015, 9414
[5]  
Bengio Y., 2012, P ICML WORKSH UNS TR, V7, P19, DOI DOI 10.5555/3045796.3045800
[6]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[7]   Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques [J].
Cheng, Jack C. P. ;
Wang, Mingzhu .
AUTOMATION IN CONSTRUCTION, 2018, 95 :155-171
[8]   UAV based wilt detection system via convolutional neural networks [J].
Dang, L. Minh ;
Hassan, Syed Ibrahim ;
Suhyeon, Im ;
Sangaiah, Arun kumar ;
Mehmood, Irfan ;
Rho, Seungmin ;
Seo, Sanghyun ;
Moon, Hyeonjoon .
SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2020, 28
[9]   Utilizing text recognition for the defects extraction in sewers CCTV inspection videos [J].
Dang, L. Minh ;
Hassan, Syed Ibrahim ;
Im, Suhyeon ;
Mehmood, Irfan ;
Moon, Hyeonjoon .
COMPUTERS IN INDUSTRY, 2018, 99 :96-109
[10]   Automated pipe defect detection and categorization using camera/laser-based profiler and artificial neural network [J].
Duran, O. ;
Althoefer, K. ;
Senevatne, L. D. .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2007, 4 (01) :118-126