A hybrid attention deep learning network for refined segmentation of cracks from shield tunnel lining images

被引:17
作者
Zhao, Shuai [1 ]
Zhang, Guokai [2 ]
Zhang, Dongming [3 ]
Tan, Daoyuan [1 ]
Huang, Hongwei [3 ]
机构
[1] Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hong Kong 999077, Peoples R China
[2] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[3] Tongji Univ, Key Lab Geotech & Underground Engn, Minist Educ, Shanghai 200092, Peoples R China
关键词
Crack segmentation; Crack disjoint problem; U-net; Channel attention; Position attention; IDENTIFICATION; DEFECTS;
D O I
10.1016/j.jrmge.2023.02.025
中图分类号
P5 [地质学];
学科分类号
0709 ; 081803 ;
摘要
This research developed a hybrid position-channel network (named PCNet) through incorporating newly designed channel and position attention modules into U-Net to alleviate the crack discontinuity problem in channel and spatial dimensions. In PCNet, the U-Net is used as a baseline to extract informative spatial and channel-wise features from shield tunnel lining crack images. A channel and a position attention module are designed and embedded after each convolution layer of U-Net to model the feature interdependencies in channel and spatial dimensions. These attention modules can make the U-Net adaptively integrate local crack features with their global dependencies. Experiments were conducted utilizing the dataset based on the images from Shanghai metro shield tunnels. The results validate the effectiveness of the designed channel and position attention modules, since they can individually increase balanced accuracy (BA) by 11.25% and 12.95%, intersection over union (IoU) by 10.79% and 11.83%, and F1 score by 9.96% and 10.63%, respectively. In comparison with the state-of-the-art models (i.e. LinkNet, PSPNet, U-Net, PANet, and Mask R-CNN) on the testing dataset, the proposed PCNet out-performs others with an improvement of BA, IoU, and F-1 score owing to the implementation of the channel and position attention modules. These evaluation metrics indicate that the proposed PCNet presents refined crack segmentation with improved performance and is a practicable approach to segment shield tunnel lining cracks in field practice. (c) 2023 Institute of Rock and Soil Mechanics, Chinese Academy of Sciences. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页码:3105 / 3117
页数:13
相关论文
共 50 条
  • [1] A deep learning-based approach for refined crack evaluation from shield tunnel lining images
    Zhao, Shuai
    Zhang, Dongming
    Xue, Yadong
    Zhou, Mingliang
    Huang, Hongwei
    AUTOMATION IN CONSTRUCTION, 2021, 132
  • [2] Deep learning-based image instance segmentation for moisture marks of shield tunnel lining
    Zhao, Shuai
    Zhang, Dong Ming
    Huang, Hong Wei
    TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2020, 95
  • [3] Efficient segmentation of water leakage in shield tunnel lining with convolutional neural network
    Wang, Wenjun
    Su, Chao
    Han, Guohui
    Dong, Yijia
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2024, 23 (02): : 671 - 685
  • [4] Deep learning-based classification and instance segmentation of leakage-area and scaling images of shield tunnel linings
    Zhao, Shuai
    Shadabfar, Mahdi
    Zhang, Dongming
    Chen, Jiayao
    Huang, Hongwei
    STRUCTURAL CONTROL & HEALTH MONITORING, 2021, 28 (06)
  • [5] CrackDenseLinkNet: a deep convolutional neural network for semantic segmentation of cracks on concrete surface images
    Manjunatha, Preetham
    Masri, Sami F.
    Nakano, Aiichiro
    Wellford, Landon Carter
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2024, 23 (02): : 796 - 817
  • [6] Efficient and Refined Deep Convolutional Features Network for the Crack Segmentation of Solar Cell Electroluminescence Images
    Wang, Chuhan
    Chen, Haiyong
    Zhao, Shenshen
    Rahman, Muhammad Rameez Ur
    IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2022, 35 (04) : 610 - 619
  • [7] A Hybrid deep learning model for effective segmentation and classification of lung nodules from CT images
    Murugesan, Malathi
    Kaliannan, Kalaiselvi
    Balraj, Shankarlal
    Singaram, Kokila
    Kaliannan, Thenmalar
    Albert, Johny Renoald
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 2667 - 2679
  • [8] VISN: virus instance segmentation network for TEM images using deep attention transformer
    Xiao, Chi
    Wang, Jun
    Yang, Shenrong
    Heng, Minxin
    Su, Junyi
    Xiao, Hao
    Song, Jingdong
    Li, Weifu
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (06)
  • [9] An intelligent detection method for precise analysis of shield tunnel lining joints based on deep learning networks and image morphology algorithms
    Ma, Yiding
    Lu, Dechun
    Kong, Fanchao
    Li, Shaohua
    Zhou, Annan
    Du, Xiuli
    GEORISK-ASSESSMENT AND MANAGEMENT OF RISK FOR ENGINEERED SYSTEMS AND GEOHAZARDS, 2025,
  • [10] Automated segmentation of the opt ic disc from fundus images using an asymmetric deep learning network
    Wang, Lei
    Gu, Juan
    Chen, Yize
    Liang, Yuanbo
    Zhang, Weijie
    Pu, Jiantao
    Chen, Hao
    PATTERN RECOGNITION, 2021, 112