Concrete crack detection using lightweight attention feature fusion single shot multibox detector

被引:68
作者
Zhu, Wei [1 ]
Zhang, Hui [1 ]
Eastwood, Joe [2 ]
Qi, Xiaolong [1 ]
Jia, Jiale [1 ]
Cao, Youren [1 ]
机构
[1] Jiangsu Univ Sci & Technol, Sch Mech Engn, Zhenjiang 212003, Peoples R China
[2] Univ Nottingham, Mfg Metrol Team, Nottingham NG8 1BB, England
关键词
Deep learning; Concrete crack detection; Feature fusion enhancement module; Attention mechanism; T-Soft NMS; NETWORK;
D O I
10.1016/j.knosys.2022.110216
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As one of the most important defects of concrete, cracks seriously threaten the service life and safety of concrete structures, and various safety incidents caused by the collapse of concrete structures have occurred. Therefore, it is essential to detect concrete cracks as soon as possible. Existing object detection methods have low detection accuracy for cracks, leading to unsatisfactory detection results. In this paper, we propose a variety of feasible modules that improve the accuracy of single shot multibox detection (SSD), which is the most efficient object detection method in terms of both accuracy and speed. First, to improve the neural network's ability to learn high-level and low-level feature maps, we propose a feature fusion enhancement module (FFEM). Second, to more effectively capture the information between feature map channels, we propose convolutional network attention (CNA). Third, to improve the anchor box fit to the ground truth box, we reset the distribution of the anchor box. Last, we propose a new type of nonmaximum suppression (NMS) named T-Soft NMS to address numerous issues with current NMS and to significantly enhance the performance of the model. We tested our method on a crack dataset, and numerous tests showed that it outperformed competing methods. In addition, we carried out ablation studies to confirm the validity and efficacy of our method.(c) 2022 Published by Elsevier B.V.
引用
收藏
页数:12
相关论文
共 57 条
[1]   Increasing the robustness of material-specific deep learning models for crack detection across different materials [J].
Alipour, Mohamad ;
Harris, Devin K. .
ENGINEERING STRUCTURES, 2020, 206
[2]  
[Anonymous], Introducing Ultralytics YOLO11
[3]  
[Anonymous], 2010, International journal of computer vision, DOI DOI 10.1007/s11263-009-0275-4
[4]  
[Anonymous], 2017, ARXIV170306870
[5]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[6]   Soft-NMS - Improving Object Detection With One Line of Code [J].
Bodla, Navaneeth ;
Singh, Bharat ;
Chellappa, Rama ;
Davis, Larry S. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5562-5570
[7]   BERT-Based Deep Spatial-Temporal Network for Taxi Demand Prediction [J].
Cao, Dun ;
Zeng, Kai ;
Wang, Jin ;
Sharma, Pradip Kumar ;
Ma, Xiaomin ;
Liu, Yonghe ;
Zhou, Siyuan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :9442-9454
[8]   Citywide Traffic Flow Prediction Based on Multiple Gated Spatio-temporal Convolutional Neural Networks [J].
Chen, Cen ;
Li, Kenli ;
Teo, Sin G. ;
Zou, Xiaofeng ;
Li, Keqin ;
Zeng, Zeng .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2020, 14 (04)
[9]   CenterNet: Keypoint Triplets for Object Detection [J].
Duan, Kaiwen ;
Bai, Song ;
Xie, Lingxi ;
Qi, Honggang ;
Huang, Qingming ;
Tian, Qi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6568-6577
[10]  
Fu C.-Y., 2017, Dssd: Deconvolutional single shot detector