Automatic concrete crack segmentation model based on transformer

被引:123
作者
Wang, Wenjun [1 ]
Su, Chao [1 ]
机构
[1] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 210098, Peoples R China
基金
中国国家自然科学基金;
关键词
Concrete crack; Pixel-wise segmentation; Visual transformer; Self-attention; Encoder-decoder; DAMAGE DETECTION;
D O I
10.1016/j.autcon.2022.104275
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Routine visual inspection of concrete structures is essential to maintain safe conditions. Therefore, studies of concrete crack segmentation using deep learning methods have been extensively conducted in recent years. However, insufficient performance remains a major challenge in diverse field-inspection scenarios. In this study, a novel SegCrack model for pixel-level crack segmentation is therefore proposed using a hierarchically structured Transformer encoder to output multiscale features and a top-down pathway with lateral connections to progressively up-sample and fuse features from the deepest layer of the encoder. Furthermore, an online hard example mining strategy was adopted to strengthen the detection of hard samples and improve the model performance. The effect of dataset size on the segmentation performance was then investigated. The results indicated that SegCrack achieved a precision, recall, F1 score, and mean intersection over union of 96.66%, 95.46%, 96.05%, and 92.63%, respectively, using the test set.
引用
收藏
页数:11
相关论文
共 45 条
[1]  
Albawi S, 2017, I C ENG TECHNOL
[2]   Automatic pixel-level crack segmentation in images using fully convolutional neural network based on residual blocks and pixel local weights [J].
Ali, Raza ;
Chuah, Joon Huang ;
Abu Talip, Mohamad Sofian ;
Mokhtar, Norrima ;
Shoaib, Muhammad Ali .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 104
[3]  
[Anonymous], 2015, P IEEE C COMP VIS PA
[4]  
Ba J.L., 2016, ARXIV PREPRINT
[5]   SDDNet: Real-Time Crack Segmentation [J].
Choi, Wooram ;
Cha, Young-Jin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (09) :8016-8025
[6]   Artificial intelligence-empowered pipeline for image-based inspection of concrete structures [J].
Chow, Jun Kang ;
Su, Zhaoyu ;
Wu, Jimmy ;
Li, Zhaofeng ;
Tan, Pin Siang ;
Liu, Kuan-fu ;
Mao, Xin ;
Wang, Yu-Hsing .
AUTOMATION IN CONSTRUCTION, 2020, 120
[7]  
Contributors M., 2020, MMSegmentation: Openmmlab semantic segmentation toolbox and benchmark
[8]  
Dosovitskiy A, 2020, ARXIV
[9]   Automatic Crack Detection on Road Pavements Using Encoder-Decoder Architecture [J].
Fan, Zhun ;
Li, Chong ;
Chen, Ying ;
Wei, Jiahong ;
Loprencipe, Giuseppe ;
Chen, Xiaopeng ;
Di Mascio, Paola .
MATERIALS, 2020, 13 (13) :1-18
[10]   Ensemble of Deep Convolutional Neural Networks for Automatic Pavement Crack Detection and Measurement [J].
Fan, Zhun ;
Li, Chong ;
Chen, Ying ;
Di Mascio, Paola ;
Chen, Xiaopeng ;
Zhu, Guijie ;
Loprencipe, Giuseppe .
COATINGS, 2020, 10 (02)