Weakly supervised crack segmentation using crack attention networks on concrete structures

被引:5
作者
Mishra, Anoop [1 ]
Gangisetti, Gopinath [1 ]
Azam, Yashar Eftekhar [2 ]
Khazanchi, Deepak [1 ]
机构
[1] Univ Nebraska, 6001 Dodge St, Omaha, NH 68182 USA
[2] Univ New Hampshire, Durham, NH USA
来源
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL | 2024年 / 23卷 / 06期
基金
美国国家科学基金会;
关键词
Structural health monitoring; machine learning; weakly supervised learning; image labels; crack detection; IDENTIFICATION;
D O I
10.1177/14759217241228150
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Crack detection or segmentation on concrete structures is a vital process in structural health monitoring (SHM). Though supervised machine learning techniques have gained tremendous success in this domain, data collection and annotation continue to be challenging. Image data collection is challenging, tedious, and laborious, including accessing representative datasets and manually labeling training data in the SHM domain. According to the literature, there are significant issues with the hand-annotation of image data. To address this gap, this paper proposes a two-stage weakly supervised learning framework utilizing a novel "crack attention network (CrANET)" with attention mechanism to detect and segment cracks on images with no human annotations in pixel-level labels. This framework classifies concrete surface images into crack or no-cracks and then uses gradient class activation mapping visualization to generate crack segmentation. Professionals and domain experts subsequently evaluate these segmentation results via a human expert validation study. As the literature suggests that weakly supervised learning is a limited practice in SHM, this research title will motivate researchers in SHM to research and develop a weakly supervised learning approach processing as state of the art.
引用
收藏
页码:3748 / 3777
页数:30
相关论文
共 54 条
  • [1] Analysis of edge-detection techniques for crack identification in bridges
    Abdel-Qader, L
    Abudayyeh, O
    Kelly, ME
    [J]. JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2003, 17 (04) : 255 - 263
  • [2] Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
    Adadi, Amina
    Berrada, Mohammed
    [J]. IEEE ACCESS, 2018, 6 : 52138 - 52160
  • [3] Weakly supervised pavement crack semantic segmentation based on multi-scale object localization and incremental annotation refinement
    Al-Huda, Zaid
    Peng, Bo
    Algburi, Riyadh Nazar Ali
    Alfasly, Saghir
    Li, Tianrui
    [J]. APPLIED INTELLIGENCE, 2023, 53 (11) : 14527 - 14546
  • [4] Bibliometric Analysis and Review of Deep Learning-Based Crack Detection Literature Published between 2010 and 2022
    Ali, Luqman
    Alnajjar, Fady
    Khan, Wasif
    Serhani, Mohamed Adel
    Al Jassmi, Hamad
    [J]. BUILDINGS, 2022, 12 (04)
  • [5] Barnes B., 2021, THESIS U NEBRASKA LI, P205
  • [6] What's the Point: Semantic Segmentation with Point Supervision
    Bearman, Amy
    Russakovsky, Olga
    Ferrari, Vittorio
    Fei-Fei, Li
    [J]. COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 549 - 565
  • [7] Vision and Deep Learning-Based Algorithms to Detect and Quantify Cracks on Concrete Surfaces from UAV Videos
    Bhowmick, Sutanu
    Nagarajaiah, Satish
    Veeraraghavan, Ashok
    [J]. SENSORS, 2020, 20 (21) : 1 - 19
  • [8] Bilen H., WSL TUTORIAL 1 INTRO
  • [9] Caglar F., 2019, MENDELEY DATA, V2
  • [10] Dhar S, 2011, PROC CVPR IEEE, P1657, DOI 10.1109/CVPR.2011.5995467