Use of Parallel ResNet for High-Performance Pavement Crack Detection and Measurement

被引:55
作者
Fan, Zhun [1 ,2 ]
Lin, Huibiao [1 ,2 ,3 ]
Li, Chong [1 ,2 ]
Su, Jian [4 ]
Bruno, Salvatore [5 ]
Loprencipe, Giuseppe [5 ]
机构
[1] Key Lab Digital Signal & Image Proc Guangdong Pro, Shantou 515063, Peoples R China
[2] Shantou Univ, Coll Engn, Shantou 515063, Peoples R China
[3] Shantou Polytech, Dept Mech & Elect Engn, Shantou 515078, Peoples R China
[4] Guangzhou Environm Protect Investment Nansha Envi, Guangzhou 511470, Peoples R China
[5] Sapienza Univ, Dept Civil Construct & Environm Engn, Via Eudossiana 18, I-00184 Rome, Italy
关键词
pavement monitoring; crack detection; crack measurement; automated distress evaluation systems; image processing; convolutional neural networks; residual network; ALGORITHM; WIDTH;
D O I
10.3390/su14031825
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the process of road pavement health and safety assessment, crack detection plays a pivotal role in a preventive maintenance strategy. Recently, Convolutional Neural Networks (CNNs) have been applied to automatically identify the cracks on concrete pavements. The effectiveness of a CNN-based road crack detection and measurement method depends on several factors, including the image segmentation of cracks with complex topology, the inference of noises with similar texture to the distress, and the sensitivity to thin cracks. The presence of shadows, strong light reflections, and road markings can also severely affect the accuracy in detection and measurement. In this study, a review of the state-of-the-art CNN methods for crack identification is presented, paying attention to existing limitations. Then, a novel deep residual convolutional neural network (Parallel ResNet) is proposed with the aim of creating a high-performance pavement crack detection and measurement system. The challenge and special feature of Parallel ResNet is to remove the noise inference, identifying even thin and complex cracks correctly. The performance of Parallel ResNet has been investigated on two publicly available datasets (CrackTree200 and CFD), comparing it with that of competing methods suggested in the literature. Parallel ResNet reached the maximum scores in Precision (94.27%), Recall (92.52%), and F1 (93.08%) using the CrackTree200 dataset. Similarly, for the CFD dataset the novel method achieved high values in Precision (96.21%), Recall (95.12%), and F1 (95.63%). Based on the crack detection and image recognition results, mathematical morphology was then used to further minimize noise and accurately segment the road diseases, obtaining the outer contours of the connected domain in crack images. Therefore, crack skeletons have been extracted to measure the distress length, width, and area on images of rigid pavements. The experimental results show that Parallel ResNet can effectively minimize noise to obtain the geometry of cracks. The results of crack characteristic measurements are accurate and Parallel ResNet can be assumed as a reliable method in pavement crack image analysis, in order to plan the best road maintenance strategy.
引用
收藏
页数:21
相关论文
共 59 条
  • [1] Acosta J.A., 1992, Transp. Res. Record, V1348, P63
  • [2] Quantifying the effects of crack width, tortuosity, and roughness on water permeability of cracked mortars
    Akhavan, Alireza
    Shafaatian, Seyed-Mohammad-Hadi
    Rajabipour, Farshad
    [J]. CEMENT AND CONCRETE RESEARCH, 2012, 42 (02) : 313 - 320
  • [3] Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection
    Amhaz, Rabih
    Chambon, Sylvie
    Idier, Jerome
    Baltazart, Vincent
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2016, 17 (10) : 2718 - 2729
  • [4] Amhaz R, 2014, IEEE IMAGE PROC, P788, DOI 10.1109/ICIP.2014.7025158
  • [5] [Anonymous], 2018, Automatic pavement crack detection based on structured prediction with the convolutional neural network
  • [6] [Anonymous], 1983, Image Vis. Comput., DOI DOI 10.1016/0262-8856(83)90063-X
  • [7] ASTM, 2020, PAV COND SURV
  • [8] Bonin G., 2017, TRANSPORT INFRASTRUC, P537
  • [9] Bray J, 2006, IEEE IJCNN, P907
  • [10] Technical Proposal for Monitoring Thermal and Mechanical Stresses of a Runway Pavement
    Bruno, Salvatore
    Del Serrone, Giulia
    Di Mascio, Paola
    Loprencipe, Giuseppe
    Ricci, Eugenio
    Moretti, Laura
    [J]. SENSORS, 2021, 21 (20)