Underground sewer pipe condition assessment based on convolutional neural networks

被引:133
作者
Hassan, Syed Ibrahim [1 ]
Dang, L. Minh [1 ]
Mehmood, Irfan [1 ]
Im, Suhyeon [1 ]
Choi, Changho [2 ]
Kang, Jaemo [2 ]
Park, Young-Soo [2 ]
Moon, Hyeonjoon [1 ]
机构
[1] Sejong Univ, Dept Comp Sci & Engn, Seoul, South Korea
[2] Korea Inst Civil Engn & Bldg Technol KICT, Ilsan, South Korea
关键词
Deep learning; Closed circuit television (CCTV); Convolutional neural network; Automation; Sewer assessment; Text recognition; Maximally Stable Extremal Regions (MSER); AUTOMATED DETECTION; DEFECT DETECTION; CLASSIFICATION; SEGMENTATION; RECOGNITION;
D O I
10.1016/j.autcon.2019.102849
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
y Surveys for assessing the condition of sewer pipeline systems are mainly based on video surveillance or CCTV, which is a time-consuming process that relies heavily on human labor because an operator has to watch videos, looks for defects and decides the defect's type manually. Previous research required suitable handcrafted features that were inefficient in analyzing sewer pipeline condition, so a robust and efficient framework is crucial as it eliminates the time-consuming tasks and helps the operator access condition of sewer systems more efficiently. This study proposes a defect classification system on CCTV inspection videos based on convolutional neural networks (CNN). The dataset was manually constructed and validated by extracting the images from CCTV videos, and the images were labeled according to six predefined defects. The CNN model was fine-tuned before training, and trained on a total of 47,072 images (256 x 256 pixels). The highest recorded accuracy was at 96.33%. As a result, the presented framework will motivate the finding of a more robust model that automatically and precisely evaluates the condition of sewer pipeline systems using CCTV and encourages the integration of the proposed model in real applications.
引用
收藏
页数:12
相关论文
共 50 条
[31]   Smooth filtering identification based on convolutional neural networks [J].
Liu, Anan ;
Zhao, Zhengyu ;
Zhang, Chengqian ;
Su, Yuting .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (19) :26851-26865
[32]   Fusion based Heterogeneous Convolutional Neural Networks Architecture [J].
Komish, David ;
Ezekiel, Soundararajan ;
Comacchia, Maria .
2018 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2018,
[33]   Semantic Segmentation System of Pigmented Skin Lesions Based on Convolutional Neural Networks [J].
Fedorenko, Vladimir V. ;
Lyakhova, Ulyana A. ;
Nagornov, Nikolay N. ;
Efimenko, Georgii A. ;
Kaplun, Dmitrii, I .
2022 11TH MEDITERRANEAN CONFERENCE ON EMBEDDED COMPUTING (MECO), 2022, :589-593
[34]   A literature review on remote sensing scene categorization based on convolutional neural networks [J].
Kaul, Ajay ;
Kumari, Monika .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (08) :2611-2642
[35]   Cochleogram-based adventitious sounds classification using convolutional neural networks [J].
Mang, L. D. ;
Canadas-Quesada, F. J. ;
Carabias-Orti, J. J. ;
Combarro, E. F. ;
Ranilla, J. .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 82
[36]   A Comprehensive Review of Convolutional Neural Networks for Defect Detection in Industrial Applications [J].
Khanam, Rahima ;
Hussain, Muhammad ;
Hill, Richard ;
Allen, Paul .
IEEE ACCESS, 2024, 12 :94250-94295
[37]   On the use of variable stride in convolutional neural networks [J].
Zaniolo, Luiz ;
Marques, Oge .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (19-20) :13581-13598
[38]   Classification of Environmental Sounds with Convolutional Neural Networks [J].
Dincer, Yalcin ;
Inik, Ozkan .
KONYA JOURNAL OF ENGINEERING SCIENCES, 2023, 11 (02)
[39]   Sentiment analysis: a convolutional neural networks perspective [J].
Diwan, Tausif ;
Tembhurne, Jitendra V. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) :44405-44429
[40]   Network Traffic Identification with Convolutional Neural Networks [J].
Jain, Akshit V. .
2018 16TH IEEE INT CONF ON DEPENDABLE, AUTONOM AND SECURE COMP, 16TH IEEE INT CONF ON PERVAS INTELLIGENCE AND COMP, 4TH IEEE INT CONF ON BIG DATA INTELLIGENCE AND COMP, 3RD IEEE CYBER SCI AND TECHNOL CONGRESS (DASC/PICOM/DATACOM/CYBERSCITECH), 2018, :1001-1007