Weakly supervised crack segmentation using crack attention networks on concrete structures

被引:8
作者
Mishra, Anoop [1 ]
Gangisetti, Gopinath [1 ]
Azam, Yashar Eftekhar [2 ]
Khazanchi, Deepak [1 ]
机构
[1] Univ Nebraska, 6001 Dodge St, Omaha, NH 68182 USA
[2] Univ New Hampshire, Durham, NH USA
来源
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL | 2024年 / 23卷 / 06期
基金
美国国家科学基金会;
关键词
Structural health monitoring; machine learning; weakly supervised learning; image labels; crack detection; IDENTIFICATION;
D O I
10.1177/14759217241228150
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Crack detection or segmentation on concrete structures is a vital process in structural health monitoring (SHM). Though supervised machine learning techniques have gained tremendous success in this domain, data collection and annotation continue to be challenging. Image data collection is challenging, tedious, and laborious, including accessing representative datasets and manually labeling training data in the SHM domain. According to the literature, there are significant issues with the hand-annotation of image data. To address this gap, this paper proposes a two-stage weakly supervised learning framework utilizing a novel "crack attention network (CrANET)" with attention mechanism to detect and segment cracks on images with no human annotations in pixel-level labels. This framework classifies concrete surface images into crack or no-cracks and then uses gradient class activation mapping visualization to generate crack segmentation. Professionals and domain experts subsequently evaluate these segmentation results via a human expert validation study. As the literature suggests that weakly supervised learning is a limited practice in SHM, this research title will motivate researchers in SHM to research and develop a weakly supervised learning approach processing as state of the art.
引用
收藏
页码:3748 / 3777
页数:30
相关论文
共 54 条
[21]   A Comprehensive Review of Deep Learning-Based Crack Detection Approaches [J].
Hamishebahar, Younes ;
Guan, Hong ;
So, Stephen ;
Jo, Jun .
APPLIED SCIENCES-BASEL, 2022, 12 (03)
[22]   Computational modelling of visual attention [J].
Itti, L ;
Koch, C .
NATURE REVIEWS NEUROSCIENCE, 2001, 2 (03) :194-203
[23]   Automatic surface crack detection using segmentation-based deep-learning approach [J].
Joshi, Deepa ;
Singh, Thipendra P. ;
Sharma, Gargeya .
ENGINEERING FRACTURE MECHANICS, 2022, 268
[24]   Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling [J].
Khaloo, Ali ;
Lattanzi, David ;
Cunningham, Keith ;
Dell'Andrea, Rodney ;
Riley, Mark .
STRUCTURE AND INFRASTRUCTURE ENGINEERING, 2018, 14 (01) :124-136
[25]  
Lee G.C., 2013, STUDY US BRIDGE FAIL
[26]   A deep residual neural network framework with transfer learning for concrete dams patch-level crack classification and weakly-supervised localization [J].
Li, Yangtao ;
Bao, Tengfei ;
Xu, Bo ;
Shu, Xiaosong ;
Zhou, Yuhang ;
Du, Ye ;
Wang, Ruijie ;
Zhang, Kang .
MEASUREMENT, 2022, 188
[27]   Weakly-supervised structural surface crack detection algorithm based on class activation map and superpixel segmentation [J].
Liu, Chao ;
Xu, Boqiang .
ADVANCES IN BRIDGE ENGINEERING, 2023, 4 (01)
[28]   Computer vision-based concrete crack detection using U-net fully convolutional networks [J].
Liu, Zhenqing ;
Cao, Yiwen ;
Wang, Yize ;
Wang, Wei .
AUTOMATION IN CONSTRUCTION, 2019, 104 :129-139
[29]   Machine learning and structural health monitoring overview with emerging technology and high-dimensional data source highlights [J].
Malekloo, Arman ;
Ozer, Ekin ;
AlHamaydeh, Mohammad ;
Girolami, Mark .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2022, 21 (04) :1906-1955
[30]   Crack detection using image processing: A critical review and analysis [J].
Mohan, Arun ;
Poobal, Sumathi .
ALEXANDRIA ENGINEERING JOURNAL, 2018, 57 (02) :787-798