Weakly supervised crack segmentation using crack attention networks on concrete structures

被引:8
作者
Mishra, Anoop [1 ]
Gangisetti, Gopinath [1 ]
Azam, Yashar Eftekhar [2 ]
Khazanchi, Deepak [1 ]
机构
[1] Univ Nebraska, 6001 Dodge St, Omaha, NH 68182 USA
[2] Univ New Hampshire, Durham, NH USA
来源
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL | 2024年 / 23卷 / 06期
基金
美国国家科学基金会;
关键词
Structural health monitoring; machine learning; weakly supervised learning; image labels; crack detection; IDENTIFICATION;
D O I
10.1177/14759217241228150
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Crack detection or segmentation on concrete structures is a vital process in structural health monitoring (SHM). Though supervised machine learning techniques have gained tremendous success in this domain, data collection and annotation continue to be challenging. Image data collection is challenging, tedious, and laborious, including accessing representative datasets and manually labeling training data in the SHM domain. According to the literature, there are significant issues with the hand-annotation of image data. To address this gap, this paper proposes a two-stage weakly supervised learning framework utilizing a novel "crack attention network (CrANET)" with attention mechanism to detect and segment cracks on images with no human annotations in pixel-level labels. This framework classifies concrete surface images into crack or no-cracks and then uses gradient class activation mapping visualization to generate crack segmentation. Professionals and domain experts subsequently evaluate these segmentation results via a human expert validation study. As the literature suggests that weakly supervised learning is a limited practice in SHM, this research title will motivate researchers in SHM to research and develop a weakly supervised learning approach processing as state of the art.
引用
收藏
页码:3748 / 3777
页数:30
相关论文
共 54 条
[41]   CBAM: Convolutional Block Attention Module [J].
Woo, Sanghyun ;
Park, Jongchan ;
Lee, Joon-Young ;
Kweon, In So .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :3-19
[42]   Data fusion approaches for structural health monitoring and system identification: Past, present, and future [J].
Wu, Rih-Teng ;
Jahanshahi, Mohammad Reza .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2020, 19 (02) :552-586
[43]   Intelligent crack detection based on attention mechanism in convolution neural network [J].
Cui, Xiaoning ;
Wang, Qicai ;
Dai, Jinpeng ;
Xue, Yanjin ;
Duan, Yun .
ADVANCES IN STRUCTURAL ENGINEERING, 2021, 24 (09) :1859-1868
[44]   Evaluating the effects of the I-35W bridge collapse on road-users in the twin cities metropolitan region [J].
Xie, Feng ;
Levinson, David .
TRANSPORTATION PLANNING AND TECHNOLOGY, 2011, 34 (07) :691-703
[45]   A Weakly Supervised Surface Defect Detection Based on Convolutional Neural Network [J].
Xu, Liang ;
Lv, Shuai ;
Deng, Yong ;
Li, Xiuxi .
IEEE ACCESS, 2020, 8 :42285-42296
[46]   Crack detection based on ResNet with spatial attention [J].
Yang, Qiaoning ;
Jiang, Si ;
Chen, Juan ;
Lin, Weiguo .
COMPUTERS AND CONCRETE, 2020, 26 (05) :411-420
[47]   Thin crack observation in a reinforced concrete bridge pier test using image processing and analysis [J].
Yang, Yuan-Sen ;
Yang, Chung-Ming ;
Huang, Chang-Wei .
ADVANCES IN ENGINEERING SOFTWARE, 2015, 83 :99-108
[48]   Automated region-of-interest localization and classification for vision-based visual assessment of civil infrastructure [J].
Yeum, Chul Min ;
Choi, Jongseong ;
Dyke, Shirley J. .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2019, 18 (03) :675-689
[49]   Real-Time Detection of Cracks on Concrete Bridge Decks Using Deep Learning in the Frequency Domain [J].
Zhang, Qianyun ;
Barri, Kaveh ;
Babanajad, Saeed K. ;
Alavi, Amir H. .
ENGINEERING, 2021, 7 (12) :1786-1796
[50]   Structural damage identification via physics-guided machine learning: a methodology integrating pattern recognition with finite element model updating [J].
Zhang, Zhiming ;
Sun, Chao .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2021, 20 (04) :1675-1688