Deep learning-based masonry crack segmentation and real-life crack length measurement

被引:39
作者
Dang, L. Minh [2 ,3 ,4 ]
Wang, Hanxiang [1 ]
Li, Yanfen [1 ]
Nguyen, Le Quan [1 ]
Nguyen, Tan N. [5 ]
Song, Hyoung-Kyu [2 ,3 ]
Moon, Hyeonjoon [1 ]
机构
[1] Sejong Univ, Dept Comp Sci & Engn, 209 Neungdong ro, Seoul 05006, South Korea
[2] Sejong Univ, Dept Informat & Commun Engn, Seoul, South Korea
[3] Sejong Univ, Convergence Engn Intelligent Drone, Seoul, South Korea
[4] FPT Univ, Dept Informat Technol, Ho Chi Minh City 70000, Vietnam
[5] Sejong Univ, Dept Architectural Engn, 209 Neungdong ro, Seoul 05006, South Korea
基金
新加坡国家研究基金会;
关键词
Masonry building; Crack segmentation; Deep learning; Measurement; Image processing; ALGORITHM; AXIS;
D O I
10.1016/j.conbuildmat.2022.129438
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
While there have been a considerable number of studies on computer vision (CV)-based crack detection on concrete/asphalt public facilities, such as sewers and tunnels, masonry-related structures have received less attention. This research seeks to implement an automated crack segmentation and a real-life crack length measurement of masonry walls using CV techniques and deep learning. The main contributions include (1) a large dataset of manually labelled images about various types of Korea masonry walls; (2) a careful performance evaluation of various deep learning-based crack segmentation models, including U-Net, DeepLabV3+, and FPN; and (3) a novel algorithm to extract real-life crack length measurement by detecting the brick units. The experimental results showed that deep learning-based masonry crack segmentation performed significantly better than previous approaches and could provide a real-life crack measurement. Therefore, it has a huge po-tential for motivating masonry-based structure investigation.
引用
收藏
页数:11
相关论文
共 32 条
[1]   DAMAGE DETECTION AND LOCALIZATION IN MASONRY STRUCTURE USING FASTER REGION CONVOLUTIONAL NETWORKS [J].
Ali, Luqman ;
Khan, Wasif ;
Chaiyasarn, Krisada .
INTERNATIONAL JOURNAL OF GEOMATE, 2019, 17 (59) :98-105
[2]   On the accuracy of UAV photogrammetric survey for the evaluation of historic masonry structural damages [J].
Cavalagli, Nicola ;
Gioffre, Massimiliano ;
Grassi, Silvia ;
Gusella, Vittorio ;
Pepi, Chiara ;
Volpi, Gian Marco .
ART COLLECTIONS 2020, SAFETY ISSUE (ARCO 2020, SAFETY), 2020, 29 :165-174
[3]  
Changxian S., 1998, ICCT 98 1998 INT C C
[4]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[5]   Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning [J].
Dais, Dimitris ;
Bal, Ihsan Engin ;
Smyrou, Eleni ;
Sarhosis, Vasilis .
AUTOMATION IN CONSTRUCTION, 2021, 125
[6]   Automatic tunnel lining crack evaluation and measurement using deep learning [J].
Dang, L. Minh ;
Wang, Hanxiang ;
Li, Yanfen ;
Park, Yesul ;
Oh, Chanmi ;
Nguyen, Tan N. ;
Moon, Hyeonjoon .
TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2022, 124
[7]   DefectTR: End-to-end defect detection for sewage networks using a transformer [J].
Dang, L. Minh ;
Wang, Hanxiang ;
Li, Yanfen ;
Nguyen, Tan N. ;
Moon, Hyeonjoon .
CONSTRUCTION AND BUILDING MATERIALS, 2022, 325
[8]   Sensor-based and vision-based human activity recognition: A comprehensive survey [J].
Dang, L. Minh ;
Min, Kyungbok ;
Wang, Hanxiang ;
Piran, Md. Jalil ;
Lee, Cheol Hee ;
Moon, Hyeonjoon .
PATTERN RECOGNITION, 2020, 108 (108)
[9]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[10]   Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning [J].
Ferguson, Max ;
Ak, Ronay ;
Lee, Yung-Tsun Tina ;
Law, Kincho H. .
SMART AND SUSTAINABLE MANUFACTURING SYSTEMS, 2018, 2 (01) :137-164