Pavement distress detection and classification based on YOLO network

被引:278
作者
Du, Yuchuan [1 ]
Pan, Ning [1 ]
Xu, Zihao [2 ]
Deng, Fuwen [1 ]
Shen, Yu [1 ]
Kang, Hua [1 ]
机构
[1] Tongji Univ, Minist Educ, Key Lab Rd & Traff Engn, Shanghai, Peoples R China
[2] Tongji Univ, Key Lab Embedded Syst & Serv Comp, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Pavement distress; object detection; image classification; YOLO network; DEEP NEURAL-NETWORKS; CRACK DETECTION; IDENTIFICATION; RECOGNITION; TRANSFORM;
D O I
10.1080/10298436.2020.1714047
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The detection and classification of pavement distress (PD) play a critical role in pavement maintenance and rehabilitation. Research on PD automation detection and measurement has been actively conducted. However, types of PD are more necessary for road managers to take effective actions. Also, lack of a unified PD dataset leads to absence of a benchmark on various methods. This study makes three contributions to address these issues. Firstly, a large-scale PD dataset is prepared. This dataset is composed of 45,788 images captured with a high-resolution industrial camera installed on vehicles, in a variety of weather and illuminance conditions. Each image is annotated with bounding box representing location and type of distress. Secondly, a deep learning-based object detection framework, the YOLO network, is adopted to predict possible distress location and category. Comprehensive detection accuracy reaches 73.64%. The processing speed reaches 0.0347s/pic, as 9 times faster than Faster R-CNN and only 70% of SSD. Finally, the applicability of model under various illumination conditions is also explored. The results reveal that the method significantly outperforms with appropriate illumination. We conclude that the proposed YOLO-based approach is able to detect PD with high accuracy, which requires no manual feature extraction and calculation during detecting.
引用
收藏
页码:1659 / 1672
页数:14
相关论文
共 47 条
[1]  
BUGAO HYX, 2006, J ELECTRON IMAGING, V15, P1
[2]  
Cao Jiannong, 2014, Journal of Computer Aided Design & Computer Graphics, V26, P1450
[3]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[4]   Multi-column deep neural network for traffic sign classification [J].
Ciresan, Dan ;
Meier, Ueli ;
Masci, Jonathan ;
Schmidhuber, Juergen .
NEURAL NETWORKS, 2012, 32 :333-338
[5]  
Coenen TBJ, 2017, COGENT ENG, V4, DOI 10.1080/23311916.2017.1374822
[6]  
Daniel A., 2014, International Journal of Computer Applications (0975 - 8887), V101, P18
[7]  
DU Y, 2018, LIGHTWEIGHT SHANGHAI
[8]   Rapid Estimation of Road Friction for Anti-Skid Autonomous Driving [J].
Du, Yuchuan ;
Liu, Chenglong ;
Song, Yang ;
Li, Yishun ;
Shen, Yu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (06) :2461-2470
[9]   Detection of Crack Growth in Asphalt Pavement Through Use of Infrared Imaging [J].
Du, Yuchuan ;
Zhang, Xiaoming ;
Li, Feng ;
Sun, Lijun .
TRANSPORTATION RESEARCH RECORD, 2017, (2645) :24-31
[10]  
EISENBACH M, 2017, IEEE IJCNN, P2039, DOI DOI 10.1109/IJCNN.2017.7966101