Deep-Learning- and Unmanned Aerial Vehicle-Based Structural Crack Detection in Concrete

被引:3
作者
Jin, Tao [1 ,2 ,3 ]
Zhang, Wen [2 ]
Chen, Chunlai [1 ]
Chen, Bin [1 ,4 ]
Zhuang, Yizhou [2 ]
Zhang, He [1 ,3 ]
机构
[1] Hangzhou City Univ, Sch Engn, Hangzhou 310015, Peoples R China
[2] Zhejiang Univ Technol, Coll Civil Engn, Hangzhou 310014, Peoples R China
[3] Zhejiang Univ, Dept Civil Engn, Hangzhou 310058, Peoples R China
[4] Zhejiang Engn Res Ctr Intelligent Urban Infrastruc, Hangzhou 310014, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; crack detection; semantic segmentation; dataset; UAV;
D O I
10.3390/buildings13123114
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Deep-learning- and unmanned aerial vehicle (UAV)-based methods facilitate structural crack detection for tall structures. However, contemporary datasets are generally established using images taken with handheld or vehicle-mounted cameras. Thus, these images might be different from those taken by UAVs in terms of resolution and lighting conditions. Considering the difficulty and complexity of establishing a crack image dataset, making full use of the current datasets can help reduce the shortage of UAV-based crack image datasets. Therefore, the performance evaluation of existing crack image datasets in training deep neural networks (DNNs) for crack detection in UAV images is essential. In this study, four DNNs were trained with different architectures based on a publicly available dataset and tested using a small UAV-based crack image dataset with 648 +pixel-wise annotated images. These DNNs were first tested using the four indices of precision, recall, mIoU, and F1, and image tests were also conducted for intuitive comparison. Moreover, a field experiment was carried out to verify the performance of the trained DNNs in detecting cracks from raw UAV structural images. The results indicate that the existing dataset can be useful to train DNNs for crack detection from UAV images; the TransUNet achieved the best performance in detecting all kinds of structural cracks.
引用
收藏
页数:15
相关论文
共 48 条
[1]  
Baltacioglu A. K, 2010, Int. J. Eng. Appl. Sci, V2, P71
[2]   Crack Segmentation on UAS-based Imagery using Transfer Learning [J].
Benz, Christian ;
Debus, Paul ;
Ha, Huy Khanh ;
Rodehorst, Volker .
2019 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2019,
[3]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[4]  
Chen J, 2021, arXiv
[5]  
Chen LC, 2016, Arxiv, DOI [arXiv:1412.7062, 10.1080/17476938708814211]
[6]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[7]   Concrete crack detection with handwriting script interferences using faster region-based convolutional neural network [J].
Deng, Jianghua ;
Lu, Ye ;
Lee, Vincent Cheng-Siong .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (04) :373-388
[8]  
Howard AG, 2017, Arxiv, DOI [arXiv:1704.04861, DOI 10.48550/ARXIV.1704.04861, 10.48550/arXiv.1704.04861]
[9]   Vibration-Based Fault Detection in Drone Using Artificial Intelligence [J].
Ghazali, Mohamad Hazwan Mohd ;
Rahiman, Wan .
IEEE SENSORS JOURNAL, 2022, 22 (09) :8439-8448
[10]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448