Generation method of pavement crack images based on deep convolutional generative adversarial networks

被引:1
作者
Pei L. [1 ]
Sun Z. [1 ]
Sun J. [1 ,2 ]
Li W. [1 ]
Zhang H. [3 ]
机构
[1] School of Information Engineering, Chang'an University, Xi'an
[2] Computer Network Center, Shihezi University, Shihezi
[3] Xi'an Xiangteng Micro-Electronics Technology Co. Ltd., Xi'an
来源
Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology) | 2021年 / 52卷 / 11期
关键词
Deep convolutional generation adversarial network(DCGAN); Deep learning; Image generation; Pavement detection;
D O I
10.11817/j.issn.1672-7207.2021.11.012
中图分类号
学科分类号
摘要
An asphalt pavement crack image generation method was proposed based on deep convolutional generative adversarial network(DCGAN) to improve the quality of a specific pavement image dataset. Firstly, the crack images were captured by a combination of in-vehicle motion camera photography and manual cell phone photography to obtain a more balanced and feature-rich sample small image set. Secondly, original images were denoised by filtering and gamma transformed to enhance the recognition of crack features in the plots, so that a training set of asphalt pavement crack data was created. Thirdly, a deep convolutional generative adversarial neural network model was constructed. The parameters of asphalt pavement crack image generation network were adjusted and its network hyperparameters was optimized to achieve a more realistic generation of pavement crack image dataset. Finally, faster regional convolutional neural network (R-CNN) detection network was used to detect the generated crack images, which can verify the effectiveness of the generated images in the detection network. The results show that the method based on deep convolutional generative adversarial network can generate more realistic crack images. The proposed method can address the problem of insufficient quantity and low quality of datasets under specific conditions more effectively than conventional augmentation methods. Inputting generated virtual images and real pavement images into the detection model can improve the pavement crack detection accuracy. © 2021, Central South University Press. All right reserved.
引用
收藏
页码:3899 / 3906
页数:7
相关论文
共 28 条
  • [1] XU Yongming, Highway maintenance and management, pp. 12-19, (1998)
  • [2] Statistical Bulletin of the Transportation Industry Development in 2018
  • [3] SUN Zhaoyun, ZHAO Haiwei, LI Wei, Et al., 3D pavement crack identification method based on dual-phase scanning detection, China Journal of Highway and Transport, 28, 2, pp. 26-32, (2015)
  • [4] LI Wei, SUN Zhaoyun, HU Yanju, Et al., Pavement crack type judgment method based on three-dimensional pavement data, China Journal of Highway and Transport, 28, 11, pp. 21-28, (2015)
  • [5] WANG Ting, Research of semi-supervised aspect-level sentiment classification based on variational autoencoder, pp. 34-47, (2018)
  • [6] LI Xiaoju, GU Junzhong, CHENG Jie, Collaborative recommendation approach based on variational recurrent auto-encoder, Computer Applications and Software, 35, 9, pp. 258-263, (2018)
  • [7] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, Et al., Generative adversarial nets, Advances in Neural Information Processing Systems, 27, pp. 2672-2680, (2014)
  • [8] DENTON E, CHINTALA S, SZLAM A, Et al., Deep generative image models using a laplacian pyramid of adversarial networks, Proceedings of the 28th International Conference on Neural Information Processing Systems, 12, 1, pp. 1486-1494, (2015)
  • [9] QI Guojun, Loss-sensitive generative adversarial networks on lipschitz densities, International Journal of Computer Vision, 128, 5, pp. 1118-1140, (2020)
  • [10] ARJOVSKY M, CHINTALA S, BOTTOU L., Wasserstein GAN