Intelligent rebar inspection based on improved Mask R-CNN and stereo vision

被引:0
作者
Wei C. [1 ]
Zhao W. [1 ,2 ]
Sun B. [1 ,2 ]
Liu Y. [1 ]
机构
[1] College of Civil Engineering and Architecture, Zhejiang University, Hangzhou
[2] Center for Balance Architecture, Zhejiang University, Hangzhou
来源
Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science) | 2024年 / 58卷 / 05期
关键词
attention mechanism; deep learning; Mask R-CNN; rebar quality inspection; stereo vision technology;
D O I
10.3785/j.issn.1008-973X.2024.05.014
中图分类号
学科分类号
摘要
A rebar inspection method based on improved mask region with convolutional neural network (Mask R-CNN) model and stereo vision technology was proposed in order to promote the transformation of reinforcement inspection to intelligence. The improved model Mask R-CNN with channel attention and spatial attention (Mask R-CNN+CA-SA) was formed by adding a bottom-up path with attention mechanism in Mask R-CNN. The diameter and spacing of rebar can be obtained by combining stereo vision technology for coordinate transformation, thereby achieving intelligent rebar inspection. The training was conducted on a self-built dataset containing 3 450 rebar pictures. Results showed that the Mask R-CNN+CA-SA model increased the F1 score and mean average precision (mAP) by 2.54% and 2.47% compared with the basic network of Mask R-CNN, respectively. The rebar mesh verification test and complex background test showed that the absolute error and relative error of rebar diameter were basically controlled within 1.7 mm and 10%, and the absolute error and relative error of rebar spacing were controlled within 4 mm and 3.2% respectively. The proposed method is highly operable in practical applications. The intelligent rebar inspection technology can greatly improve work efficiency and reduce labor costs while ensuring sufficient inspection accuracy. © 2024 Zhejiang University. All rights reserved.
引用
收藏
页码:1009 / 1019
页数:10
相关论文
共 32 条
[1]  
SUN Hao, Research on fast inspection method of reinforcement based on digital image, (2019)
[2]  
KIM M K, THEDJA J P P, WANG Q., Automated dimensional quality assessment for formwork and rebar of reinforced concrete components using 3D point cloud data, Automation in Construction, 112, (2020)
[3]  
CHI H L, KIM M K, LIU K Z, Et al., Rebar inspection integrating augmented reality and laser scanning, Automation in Construction, 136, (2022)
[4]  
YANG X, LI X, YE Y, Et al., Road detection and centerline extraction via deep recurrent convolutional neural network U-Net [J], IEEE Transactions on Geoscience and Remote Sensing, 57, 9, pp. 7209-7220, (2019)
[5]  
PAN Y, ZHANG L., Dual attention deep learning network for automatic steel surface defect segmentation [J], Computer-Aided Civil and Infrastructure Engineering, 37, 11, pp. 1468-1487, (2022)
[6]  
LI S, ZHAO X., A performance improvement strategy for concrete damage detection using stacking ensemble learning of multiple semantic segmentation networks, Sensors, 22, 9, (2022)
[7]  
YAO Gang, LIAO Gang, YANG Yang, Et al., Multi-target intelligent detection method of prefabricated laminated board based on convolutional neural network, Journal of Civil and Environmental Engineering, 46, 1, pp. 93-101, (2024)
[8]  
DONG Guoliang, ZHANG Lei, XIN Shan, Target recognition and location of steel bar binding robot based on deep learning [J], Electronic Measurement Technology, 45, 11, pp. 35-44, (2022)
[9]  
JIN J, ZHANG W, LI F, Et al., Robotic binding of rebar based on active perception and planning, Automation in Construction, 132, (2021)
[10]  
LI Y, LU Y, CHEN J., A deep learning approach for real-time rebar counting on the construction site based on YOLOv3 detector, Automation in Construction, 124, (2021)