A Novel Hybrid Approach for Concrete Crack Segmentation Based on Deformable Oriented-YOLOv4 and Image Processing Techniques

被引:7
作者
He, Zengsheng [1 ]
Su, Cheng [1 ,2 ,3 ]
Deng, Yichuan [1 ,2 ,3 ]
机构
[1] South China Univ Technol, Sch Civil Engn & Transportat, Guangzhou 510641, Peoples R China
[2] South China Univ Technol, State Key Lab Subtrop Bldg Sci, Guangzhou 510641, Peoples R China
[3] Guangdong Artificial Intelligence & Digital Econ L, Guangzhou 510641, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 05期
基金
中国国家自然科学基金;
关键词
computer vision; convolutional neural network; YOLOv4; image processing techniques; crack detection; crack segmentation; NETWORK;
D O I
10.3390/app14051892
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Regular crack inspection plays a significant role in the maintenance of concrete structures. However, most deep-learning-based methods suffer from the heavy workload of pixel-level labeling and the poor performance of crack segmentation with the presence of background interferences. To address these problems, the Deformable Oriented YOLOv4 (DO-YOLOv4) is first developed for crack detection based on the traditional YOLOv4, in which crack features can be effectively extracted by deformable convolutional layers, and the crack regions can be tightly enclosed by a series of oriented bounding boxes. Then, the proposed DO-YOLOv4 is further utilized in combination with the image processing techniques (IPTs), leading to a novel hybrid approach, termed DO-YOLOv4-IPTs, for crack segmentation. The experimental results show that, owing to the high precision of DO-YOLOv4 for crack detection under background noise, the present hybrid approach DO-YOLOv4-IPTs outperforms the widely used Convolutional Neural Network (CNN)-based crack segmentation methods with less labeling work and superior segmentation accuracy.
引用
收藏
页数:15
相关论文
共 65 条
[1]   Analysis of edge-detection techniques for crack identification in bridges [J].
Abdel-Qader, L ;
Abudayyeh, O ;
Kelly, ME .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2003, 17 (04) :255-263
[2]   Structural crack detection using deep convolutional neural networks [J].
Ali, Raza ;
Chuah, Joon Huang ;
Abu Talip, Mohamad Sofian ;
Mokhtar, Norrima ;
Shoaib, Muhammad Ali .
AUTOMATION IN CONSTRUCTION, 2022, 133
[3]   Robust Pixel-Level Crack Detection Using Deep Fully Convolutional Neural Networks [J].
Alipour, Mohamad ;
Harris, Devin K. ;
Miller, Gregory R. .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2019, 33 (06)
[4]  
[Anonymous], 2020, RoLabelImg
[5]   Evaluating pavement cracks with bidimensional empirical mode decomposition [J].
Ayenu-Prah, Albert ;
Attoh-Okine, Nii .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2008, 2008 (1)
[6]  
Ba J, 2014, ACS SYM SER
[7]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934, DOI 10.48550/ARXIV.2004.10934]
[8]   Survey on performance of deep learning models for detecting road damages using multiple dashcam image resources [J].
Cao, Minh-Tu ;
Tran, Quoc-Viet ;
Nguyen, Ngoc-Mai ;
Chang, Kuan-Tsung .
ADVANCED ENGINEERING INFORMATICS, 2020, 46
[9]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[10]   A novel U-shaped encoder-decoder network with attention mechanism for detection and evaluation of road cracks at pixel level [J].
Chen, Jun ;
He, Ye .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2022, 37 (13) :1721-1736