Self-training method for structural crack detection using image blending-based domain mixing and mutual learning

被引:0
作者
Nguyen, Quang Du [1 ]
Thai, Huu-Tai [1 ]
Nguyen, Son Dong [2 ]
机构
[1] Univ Melbourne, Dept Infrastructure Engn, Parkville, VIC 3010, Australia
[2] Sejong Univ, Civil & Environm Engn Dept, Seoul 05006, South Korea
基金
澳大利亚研究理事会;
关键词
Crack detection; Unsupervised learning; Domain adaptive segmentation; Image blending; Self-training; Convolutional neural networks; Transformers;
D O I
10.1016/j.autcon.2024.105892
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Deep learning-based structural crack detection utilizing fully supervised methods requires laborious labeling of training data. Moreover, models trained on one dataset often experience significant performance drops when applied to others due to domain shifts prompted by diverse structures, materials, and environmental conditions. This paper addresses the issues by introducing a robust self-training domain adaptive segmentation (STDASeg) pipeline. STDASeg incorporates an image blending-based domain mixing module to minimize domain discrepancies. Additionally, STDASeg involves a two-stage self-training framework characterized by the mutual learning scheme between Convolutional Neural Networks and Transformers, effectively learning domain invariant features from the two domains. Comprehensive evaluations across three challenging cross-dataset crack detection scenarios highlight the superiority of STDASeg over traditional supervised training approaches and current state-of-the-art methods. These results confirm the stability of STDASeg, thus supporting more efficient infrastructure assessments.
引用
收藏
页数:19
相关论文
共 59 条
[1]   Structural crack detection using deep convolutional neural networks [J].
Ali, Raza ;
Chuah, Joon Huang ;
Abu Talip, Mohamad Sofian ;
Mokhtar, Norrima ;
Shoaib, Muhammad Ali .
AUTOMATION IN CONSTRUCTION, 2022, 133
[2]   Learning CNN on ViT: A Hybrid Model to Explicitly Class-specific Boundaries for Domain Adaptation [J].
Ba Hung Ngo ;
Nhat-Tuong Do-Tran ;
Tuan-Ngoc Nguyen ;
Hae-Gon Jeon ;
Tae Jong Choi .
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, :28545-28554
[3]   Image augmentation to improve construction resource detection using generative adversarial networks, cut-and-paste, and image transformation techniques [J].
Bang, Seongdeok ;
Baek, Francis ;
Park, Somin ;
Kim, Wontae ;
Kim, Hyoungkwan .
AUTOMATION IN CONSTRUCTION, 2020, 115
[4]  
Cao Hu, 2023, Computer Vision - ECCV 2022 Workshops: Proceedings. Lecture Notes in Computer Science (13803), P205, DOI 10.1007/978-3-031-25066-8_9
[5]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[6]   Hierarchical Dynamic Image Harmonization [J].
Chen, Haoxing ;
Gu, Zhangxuan ;
Li, Yaohui ;
Lan, Jun ;
Meng, Changhua ;
Wang, Weiqiang ;
Li, Huaxiong .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, :1422-1430
[7]  
Chen J., 2021, arXiv, DOI DOI 10.48550/ARXIV.2102.04306
[8]   Domain Adaptation for Semantic Segmentation with Maximum Squares Loss [J].
Chen, Minghao ;
Xue, Hongyang ;
Cai, Deng .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2090-2099
[9]   Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision [J].
Chen, Xiaokang ;
Yuan, Yuhui ;
Zeng, Gang ;
Wang, Jingdong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2613-2622
[10]   CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency [J].
Chen, Yun-Chun ;
Lin, Yen-Yu ;
Yang, Ming-Hsuan ;
Huang, Jia-Bin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1791-1800