Self-training method for structural crack detection using image blending-based domain mixing and mutual learning

被引:0
作者
Nguyen, Quang Du [1 ]
Thai, Huu-Tai [1 ]
Nguyen, Son Dong [2 ]
机构
[1] Univ Melbourne, Dept Infrastructure Engn, Parkville, VIC 3010, Australia
[2] Sejong Univ, Civil & Environm Engn Dept, Seoul 05006, South Korea
基金
澳大利亚研究理事会;
关键词
Crack detection; Unsupervised learning; Domain adaptive segmentation; Image blending; Self-training; Convolutional neural networks; Transformers;
D O I
10.1016/j.autcon.2024.105892
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Deep learning-based structural crack detection utilizing fully supervised methods requires laborious labeling of training data. Moreover, models trained on one dataset often experience significant performance drops when applied to others due to domain shifts prompted by diverse structures, materials, and environmental conditions. This paper addresses the issues by introducing a robust self-training domain adaptive segmentation (STDASeg) pipeline. STDASeg incorporates an image blending-based domain mixing module to minimize domain discrepancies. Additionally, STDASeg involves a two-stage self-training framework characterized by the mutual learning scheme between Convolutional Neural Networks and Transformers, effectively learning domain invariant features from the two domains. Comprehensive evaluations across three challenging cross-dataset crack detection scenarios highlight the superiority of STDASeg over traditional supervised training approaches and current state-of-the-art methods. These results confirm the stability of STDASeg, thus supporting more efficient infrastructure assessments.
引用
收藏
页数:19
相关论文
共 59 条
[21]   High-resolution concrete damage image synthesis using conditional generative adversarial network [J].
Li, Shengyuan ;
Zhao, Xuefeng .
AUTOMATION IN CONSTRUCTION, 2023, 147
[22]  
Li S, 2021, AAAI CONF ARTIF INTE, V35, P8455
[23]   Region-aware Adaptive Instance Normalization for Image Harmonization [J].
Ling, Jun ;
Xue, Han ;
Song, Li ;
Xie, Rong ;
Gu, Xiao .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :9357-9366
[24]   DeepCrack: A deep hierarchical feature learning architecture for crack segmentation [J].
Liu, Yahui ;
Yao, Jian ;
Lu, Xiaohu ;
Xie, Renping ;
Li, Li .
NEUROCOMPUTING, 2019, 338 :139-153
[25]   Swin Transformer: Hierarchical Vision Transformer using Shifted Windows [J].
Liu, Ze ;
Lin, Yutong ;
Cao, Yue ;
Hu, Han ;
Wei, Yixuan ;
Zhang, Zheng ;
Lin, Stephen ;
Guo, Baining .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9992-10002
[26]  
Luo XD, 2022, PR MACH LEARN RES, V172, P820
[27]   Efficient Semi-supervised Gross Target Volume of Nasopharyngeal Carcinoma Segmentation via Uncertainty Rectified Pyramid Consistency [J].
Luo, Xiangde ;
Liao, Wenjun ;
Chen, Jieneng ;
Song, Tao ;
Chen, Yinan ;
Zhang, Shichuan ;
Chen, Nianyong ;
Wang, Guotai ;
Zhang, Shaoting .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 :318-329
[28]   Generative adversarial network for road damage detection [J].
Maeda, Hiroya ;
Kashiyama, Takehiro ;
Sekimoto, Yoshihide ;
Seto, Toshikazu ;
Omata, Hiroshi .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2021, 36 (01) :47-60
[29]   Densely connected deep neural network considering connectivity of pixels for automatic crack detection [J].
Mei, Qipei ;
Gul, Mustafa ;
Azim, Md Riasat .
AUTOMATION IN CONSTRUCTION, 2020, 110
[30]   V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation [J].
Milletari, Fausto ;
Navab, Nassir ;
Ahmadi, Seyed-Ahmad .
PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2016, :565-571