Weakly-supervised structural surface crack detection algorithm based on class activation map and superpixel segmentation

被引:5
作者
Liu, Chao [1 ]
Xu, Boqiang [1 ]
机构
[1] Tongji Univ, Coll Civil Engn, Dept Bridge Engn, Shanghai 200092, Peoples R China
来源
ADVANCES IN BRIDGE ENGINEERING | 2023年 / 4卷 / 01期
关键词
Crack detection; Transfer learning; Convolutional neural networks; Class activation map; Superpixel;
D O I
10.1186/s43251-023-00106-0
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper proposes a weakly-supervised structural surface crack detection algorithm that can detect the crack area in an image with low data labeling cost. The algorithm consists of a convolutional neural networks Vgg16-Crack for classification, an improved and optimized class activation map (CAM) algorithm for accurately reflecting the position and distribution of cracks in the image, and a method that combines superpixel segmentation algorithm simple linear iterative clustering (SLIC) with CAM for more accurate semantic segmentation of cracks. In addition, this paper uses Bayesian optimization algorithm to obtain the optimal parameter combination that maximizes the performance of the model. The test results show that the algorithm only requires image-level labeling, which can effectively reduce the labor and material consumption brought by pixel-level labeling while ensuring accuracy.
引用
收藏
页数:25
相关论文
共 31 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Grad-CAM plus plus : Generalized Gradient-based Visual Explanations for Deep Convolutional Networks [J].
Chattopadhay, Aditya ;
Sarkar, Anirban ;
Howlader, Prantik ;
Balasubramanian, Vineeth N. .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :839-847
[3]   Concrete crack detection with handwriting script interferences using faster region-based convolutional neural network [J].
Deng, Jianghua ;
Lu, Ye ;
Lee, Vincent Cheng-Siong .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (04) :373-388
[4]   Efficient graph-based image segmentation [J].
Felzenszwalb, PF ;
Huttenlocher, DP .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 59 (02) :167-181
[5]  
Frazier P. I., 2018, Recent Advances in Optimization and Modeling of contemporary problems, P255, DOI [10.1287/educ.2018.0188, DOI 10.1287/EDUC.2018.0188]
[6]  
Giordano D, 2015, PROC CVPR IEEE, P4814, DOI 10.1109/CVPR.2015.7299114
[7]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[8]   Facade defects classification from imbalanced dataset using meta learning-based convolutional neural network [J].
Guo, Jingjing ;
Wang, Qian ;
Li, Yiting ;
Liu, Pengkun .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (12) :1403-1418
[9]   Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing [J].
Huang, Zilong ;
Wang, Xinggang ;
Wang, Jiasi ;
Liu, Wenyu ;
Wang, Jingdong .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7014-7023
[10]  
Ibrahim A, 2020, Journal of Computer Science and Information Systems, V15, P1