Automatic defect detection and segmentation of tunnel surface using modified Mask R-CNN

被引:167
作者
Xu, Yingying [1 ]
Li, Dawei [2 ]
Xie, Qian [2 ]
Wu, Qiaoyun [2 ]
Wang, Jun [2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Mech & Elect Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Leakage; Spalling; Defect detection; Deep learning; Mask R-CNN; Instance segmentation; CRACK;
D O I
10.1016/j.measurement.2021.109316
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The detection of tunnel surface defects is the very important part to ensure tunnel safety. Traditional tunnel detection mainly relies on naked-eye inspection, which is time-consuming and error-prone. In the past few years, many defect detection methods based on computer vision have been introduced. However, these methods with manual feature extraction do not perform well in detecting tunnel defects due to the complicated background of tunnel surfaces. To address these problems, this paper proposes a novel tunnel defect inspection method based on the Mask R-CNN. To improve the accuracy of the network, we endow it with a path augmentation feature pyramid network (PAFPN) and an edge detection branch. These improvements are easy to implement, with subtle extra memory and computational overhead. In this paper, we perform a detailed study of the PAFPN and the edge detection branch, and the experiment results show their robustness and accuracy in tunnel defect detection and segmentation.
引用
收藏
页数:13
相关论文
共 53 条
  • [11] Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation
    Ghiasi, Golnaz
    Fowlkes, Charless C.
    [J]. COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 519 - 534
  • [12] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448
  • [13] Rich feature hierarchies for accurate object detection and semantic segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 580 - 587
  • [14] He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
  • [15] He KM, 2014, LECT NOTES COMPUT SC, V8691, P346, DOI [arXiv:1406.4729, 10.1007/978-3-319-10578-9_23]
  • [16] Reducing the dimensionality of data with neural networks
    Hinton, G. E.
    Salakhutdinov, R. R.
    [J]. SCIENCE, 2006, 313 (5786) : 504 - 507
  • [17] HU X., 2008, TUNNEL CONST, P7
  • [18] Deep learning based image recognition for crack and leakage defects of metro shield tunnel
    Huang, Hong-wei
    Li, Qing-tong
    Zhang, Dong-ming
    [J]. TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2018, 77 : 166 - 176
  • [19] Surface damage detection for steel wire ropes using deep learning and computer vision techniques
    Huang, Xinyuan
    Liu, Zhiliang
    Zhang, Xinyu
    Kang, Jinlong
    Zhang, Mian
    Guo, Yongliang
    [J]. MEASUREMENT, 2020, 161
  • [20] Mask Scoring R-CNN
    Huang, Zhaojin
    Huang, Lichao
    Gong, Yongchao
    Huang, Chang
    Wang, Xinggang
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 6402 - 6411