Weakly supervised crack segmentation using crack attention networks on concrete structures

被引:8
作者
Mishra, Anoop [1 ]
Gangisetti, Gopinath [1 ]
Azam, Yashar Eftekhar [2 ]
Khazanchi, Deepak [1 ]
机构
[1] Univ Nebraska, 6001 Dodge St, Omaha, NH 68182 USA
[2] Univ New Hampshire, Durham, NH USA
来源
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL | 2024年 / 23卷 / 06期
基金
美国国家科学基金会;
关键词
Structural health monitoring; machine learning; weakly supervised learning; image labels; crack detection; IDENTIFICATION;
D O I
10.1177/14759217241228150
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Crack detection or segmentation on concrete structures is a vital process in structural health monitoring (SHM). Though supervised machine learning techniques have gained tremendous success in this domain, data collection and annotation continue to be challenging. Image data collection is challenging, tedious, and laborious, including accessing representative datasets and manually labeling training data in the SHM domain. According to the literature, there are significant issues with the hand-annotation of image data. To address this gap, this paper proposes a two-stage weakly supervised learning framework utilizing a novel "crack attention network (CrANET)" with attention mechanism to detect and segment cracks on images with no human annotations in pixel-level labels. This framework classifies concrete surface images into crack or no-cracks and then uses gradient class activation mapping visualization to generate crack segmentation. Professionals and domain experts subsequently evaluate these segmentation results via a human expert validation study. As the literature suggests that weakly supervised learning is a limited practice in SHM, this research title will motivate researchers in SHM to research and develop a weakly supervised learning approach processing as state of the art.
引用
收藏
页码:3748 / 3777
页数:30
相关论文
共 54 条
[31]  
Northcutt C.G., 2021, Pervasive label errors in test sets destabilize machine learning benchmarks
[32]  
Reghukumar Arathi, 2021, Advances in Electrical and Computer Technologies. Select Proceedings of ICAECT 2020. Lecture Notes in Electrical Engineering (LNEE 711), P211, DOI 10.1007/978-981-15-9019-1_19
[33]  
Sambasivan Nithya, 2021, Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, P1, DOI [DOI 10.1145/3411764.3445518, 10.1145/3411764.3445518]
[34]  
Selvaraju RR, 2020, INT J COMPUT VISION, V128, P336, DOI [10.1109/ICCV.2017.74, 10.1007/s11263-019-01228-7]
[35]   Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring [J].
Spencer, Billie F., Jr. ;
Hoskere, Vedhus ;
Narazaki, Yasutaka .
ENGINEERING, 2019, 5 (02) :199-222
[36]   Review of Bridge Structural Health Monitoring Aided by Big Data and Artificial Intelligence: From Condition Assessment to Damage Detection [J].
Sun, Limin ;
Shang, Zhiqiang ;
Xia, Ye ;
Bhowmick, Sutanu ;
Nagarajaiah, Satish .
JOURNAL OF STRUCTURAL ENGINEERING, 2020, 146 (05)
[37]  
Tan C., 2019, 9 INT C STRUCT HLTH
[38]  
US department of transportation, 2022, BUILD BETT AM FACT S
[39]   Pixel-level tunnel crack segmentation using a weakly supervised annotation approach [J].
Wang, Hanxiang ;
Li, Yanfen ;
Dang, L. Minh ;
Lee, Sujin ;
Moon, Hyeonjoon .
COMPUTERS IN INDUSTRY, 2021, 133
[40]   Automated Transverse Crack Mapping System with Optical Sensors and Big Data Analytics [J].
Won, Kwanghee ;
Sim, Chungwook .
SENSORS, 2020, 20 (07)