Automatic intelligent recognition of pavement distresses with limited dataset using generative adversarial networks

被引:29
作者
Liu, Zhuo [1 ]
Pan, Shuo [1 ]
Gao, Zhiwei [2 ]
Chen, Ning [1 ]
Li, Feng [3 ]
Wang, Linbing [4 ]
Hou, Yue [5 ]
机构
[1] Beijing Univ Technol, Beijing Key Lab Traff Engn, Beijing 100124, Peoples R China
[2] Univ Glasgow, James Watt Sch Engn, Glasgow G12 8LT, Lanark, Scotland
[3] Beihang Univ, Sch Transportat Sci & Engn, Beijing 102206, Peoples R China
[4] Univ Georgia, Sch Environm Civil Mech & Agr Engn, Athens, GA 30602 USA
[5] Swansea Univ, Dept Civil Engn, Fac Sci & Engn, Swansea, W Glam, Wales
基金
中国国家自然科学基金;
关键词
Automatic intelligent recognition; Pavement distresses; Lightweight GAN; Multiscale convolution; Depthwise separable convolution;
D O I
10.1016/j.autcon.2022.104674
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Automatic monitoring of pavement structure health has always been a significant problem for transportation engineers. Although the generative adversarial network (GAN) has proven to be an effective tool for improving pavement distress recognition accuracy, it may lead to increased computational cost, which inconsistent with the requirements of engineering practice. This paper describes a lightweight GAN structure for automatic pavement distress identification with high computation efficiency and low computation cost. Squeeze and expand (SE), multiscale convolution (MC), and depthwise separable convolution (DSC) were selected as alternative lightweight methods, and two series of comparative experiments were conducted. The results showed that the GAN-based model with SE implemented on its fully connected layer, MC&DSC implemented on its transpose convolution layers in the generator, and MC implemented on its convolution layers in the discriminator could reduce the largest proportion of model parameters (94.8%) while achieving satisfactory classification accuracy (85.4%).
引用
收藏
页数:14
相关论文
共 45 条
[1]   A Vision-based System for Traffic Anomaly Detection using Deep Learning and Decision Trees [J].
Aboah, Armstrong ;
Shoman, Maged ;
Mandal, Vishal ;
Davami, Sayedomidreza ;
Adu-Gyamfi, Yaw ;
Sharma, Anuj .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :4202-4207
[2]   Image augmentation to improve construction resource detection using generative adversarial networks, cut-and-paste, and image transformation techniques [J].
Bang, Seongdeok ;
Baek, Francis ;
Park, Somin ;
Kim, Wontae ;
Kim, Hyoungkwan .
AUTOMATION IN CONSTRUCTION, 2020, 115
[3]  
Behzadian A, 2022, Arxiv, DOI arXiv:2206.04874
[4]   Pothole detection using location-aware convolutional neural networks [J].
Chen, Hanshen ;
Yao, Minghai ;
Gu, Qinlong .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (04) :899-911
[5]   Data Augmentation and Intelligent Recognition in Pavement Texture Using a Deep Learning [J].
Chen, Ning ;
Xu, Zijin ;
Liu, Zhuo ;
Chen, Yihan ;
Miao, Yinghao ;
Li, Qiuhan ;
Hou, Yue ;
Wang, Linbing .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (12) :25427-25436
[6]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[7]   Pavement distress detection and classification based on YOLO network [J].
Du, Yuchuan ;
Pan, Ning ;
Xu, Zihao ;
Deng, Fuwen ;
Shen, Yu ;
Kang, Hua .
INTERNATIONAL JOURNAL OF PAVEMENT ENGINEERING, 2021, 22 (13) :1659-1672
[8]  
Howard AG, 2017, Arxiv, DOI [arXiv:1704.04861, DOI 10.48550/ARXIV.1704.04861]
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[10]   Automated pixel-level pavement distress detection based on stereo vision and deep learning [J].
Guan, Jinchao ;
Yang, Xu ;
Ding, Ling ;
Cheng, Xiaoyun ;
Lee, Vincent C. S. ;
Jin, Can .
AUTOMATION IN CONSTRUCTION, 2021, 129