A Multi-Stage Feature Aggregation and Structure Awareness Network for Concrete Bridge Crack Detection

被引:3
作者
Zhang, Erhu [1 ]
Jiang, Tao [1 ]
Duan, Jinghong [2 ]
机构
[1] Xian Univ Technol, Dept Informat Sci, Xian 710048, Peoples R China
[2] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Peoples R China
关键词
concrete bridge crack detection; structure awareness; feature attention fusion; multi-stage feature aggregation; strip convolution;
D O I
10.3390/s24051542
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the most significant problems affecting a concrete bridge's safety is cracks. However, detecting concrete bridge cracks is still challenging due to their slender nature, low contrast, and background interference. The existing convolutional methods with square kernels struggle to capture crack features effectively, fail to perceive the long-range dependencies between crack regions, and have weak suppression ability for background noises, leading to low detection precision of bridge cracks. To address this problem, a multi-stage feature aggregation and structure awareness network (MFSA-Net) for pixel-level concrete bridge crack detection is proposed in this paper. Specifically, in the coding stage, a structure-aware convolution block is proposed by combining square convolution with strip convolution to perceive the linear structure of concrete bridge cracks. Square convolution is used to capture detailed local information. In contrast, strip convolution is employed to interact with the local features to establish the long-range dependence relationship between discrete crack regions. Unlike the self-attention mechanism, strip convolution also suppresses background interference near crack regions. Meanwhile, the feature attention fusion block is presented for fusing features from the encoder and decoder at the same stage, which can sharpen the edges of concrete bridge cracks. In order to fully utilize the shallow detail features and deep semantic features, the features from different stages are aggregated to obtain fine-grained segmentation results. The proposed MFSA-Net was trained and evaluated on the publicly available concrete bridge crack dataset and achieved average results of 73.74%, 77.04%, 75.30%, and 60.48% for precision, recall, F1 score, and IoU, respectively, on three typical sub-datasets, thus showing optimal performance in comparison with other existing methods. MFSA-Net also gained optimal performance on two publicly available concrete pavement crack datasets, thereby indicating its adaptability to crack detection across diverse scenarios.
引用
收藏
页数:21
相关论文
共 49 条
  • [1] Automatic pixel-level crack segmentation in images using fully convolutional neural network based on residual blocks and pixel local weights
    Ali, Raza
    Chuah, Joon Huang
    Abu Talip, Mohamad Sofian
    Mokhtar, Norrima
    Shoaib, Muhammad Ali
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 104
  • [2] ARF-Crack: rotation invariant deep fully convolutional network for pixel-level crack detection
    Chen, Fu-Chen
    Jahanshahi, Mohammad R.
    [J]. MACHINE VISION AND APPLICATIONS, 2020, 31 (06)
  • [3] Data-Driven Fault Detection for Dynamic Systems With Performance Degradation: A Unified Transfer Learning Framework
    Chen, Hongtian
    Chai, Zheng
    Jiang, Bin
    Huang, Biao
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70 (70)
  • [4] Cheng JR, 2018, TENCON IEEE REGION, P0462, DOI 10.1109/TENCON.2018.8650059
  • [5] SDDNet: Real-Time Crack Segmentation
    Choi, Wooram
    Cha, Young-Jin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (09) : 8016 - 8025
  • [6] SpinNet: Spinning convolutional network for lane boundary detection
    Fan, Ruochen
    Wang, Xuanrun
    Hou, Qibin
    Liu, Hanchao
    Mu, Tai-Jiang
    [J]. COMPUTATIONAL VISUAL MEDIA, 2019, 5 (04) : 417 - 428
  • [7] Automatic Crack Detection on Road Pavements Using Encoder-Decoder Architecture
    Fan, Zhun
    Li, Chong
    Chen, Ying
    Wei, Jiahong
    Loprencipe, Giuseppe
    Chen, Xiaopeng
    Di Mascio, Paola
    [J]. MATERIALS, 2020, 13 (13) : 1 - 18
  • [8] Guo MH, 2022, Arxiv, DOI arXiv:2209.08575
  • [9] Guo MH, 2022, Arxiv, DOI arXiv:2202.09741
  • [10] CrackW-Net: A Novel Pavement Crack Image Segmentation Convolutional Neural Network
    Han, Chengjia
    Ma, Tao
    Huyan, Ju
    Huang, Xiaoming
    Zhang, Yanning
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 22135 - 22144