Fine-Grained Detection of Pavement Distress Based on Integrated Data Using Digital Twin

被引:7
|
作者
Wang, Weidong [1 ,2 ,3 ]
Xu, Xinyue [1 ,2 ,3 ]
Peng, Jun [1 ,2 ,3 ]
Hu, Wenbo [1 ,2 ,3 ]
Wu, Dingze [1 ,2 ,3 ]
机构
[1] Cent South Univ, Sch Civil Engn, Changsha 410075, Peoples R China
[2] Cent South Univ, MOE, Key Lab Engn Struct Heavy Haul Railway, Changsha 410075, Peoples R China
[3] Cent South Univ, Ctr Railway Infrastruct Smart Monitoring & Managem, Changsha 410075, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 07期
基金
中国国家自然科学基金;
关键词
road engineering; pavement-distress detection; digital twin; integrated data; physical engine; deep-object detection network; CONVOLUTIONAL NEURAL-NETWORKS; CRACK DETECTION; FRAMEWORK;
D O I
10.3390/app13074549
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The automated detection of distress such as cracks or potholes is a key basis for assessing the condition of pavements and deciding on their maintenance. A fine-grained pavement distress-detection algorithm based on integrated data using a digital twin is proposed to solve the challenges of the insufficiency of high-quality negative samples in specific scenarios An asphalt pavement background model is created based on UAV-captured images, and a lightweight physical engine is used to randomly render 5 types of distress and 3 specific scenarios to the background model, generating a digital twin model that can provide virtual distress data. The virtual data are combined with real data in different virtual-to-real ratios (0:1 to 5:1) to form an integrated dataset and used to fully train deep object detection networks for fine-grained detection. The results show that the YOLOv5 network with the virtual-to-real ratio of 3:1 achieves the best average precision for 5 types of distress (asphalt pavement MAP: 75.40%), with a 2-fold and 1.5-fold improvement compared to models developed without virtual data and with traditional data augmentation, respectively, and achieves over 40% recall in shadow, occlusion and blur. The proposed approach could provide a more reliable and refined automated method for pavement analysis in complex scenarios.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Fine-Grained Accident Detection: Database and Algorithm
    Yu, Hongyang
    Zhang, Xinfeng
    Wang, Yaowei
    Huang, Qingming
    Yin, Baocai
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1059 - 1069
  • [42] CANCEREMO : A Dataset for Fine-Grained Emotion Detection
    Sosea, Tiberiu
    Caragea, Cornelia
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 8892 - 8904
  • [43] Fine-grained Conflict Detection of IoT Services
    Chaki, Dipankar
    Bouguettaya, Athman
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2020), 2020, : 321 - 328
  • [44] Evaluation of Fine-Grained Tropical Soils' Resilient Behaviour for Pavement Design
    Landim Alves Moreira, Claudio Rafael Cicuto
    Rodrigues Guimaraes, Antonio Carlos
    Correa Nascimento, Filipe Almeida
    Assad dos Santos, Juliana Tanabe
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON TRANSPORTATION GEOTECHNICS, VOL 4, ICTG 2024, 2025, 405 : 255 - 266
  • [45] Code Clone Detection using Coarse and Fine-grained Hybrid Approaches
    Sheneamer, Abdullah
    Kalita, Jugal
    2015 IEEE SEVENTH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INFORMATION SYSTEMS (ICICIS), 2015, : 472 - 480
  • [46] DriverSonar: Fine-Grained Dangerous Driving Detection Using Active Sonar
    Jiang, Hongbo
    Hu, Jingyang
    Liu, Daibo
    Xiong, Jie
    Cai, Mingjie
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (03):
  • [47] mmDrive: Fine-grained Fatigue Driving Detection Using mmWave Radar
    Zhu Juncen
    Cao, Jiannong
    Yang, Yanni
    Ren, Wei
    Han, Huizi
    ACM TRANSACTIONS ON INTERNET OF THINGS, 2023, 4 (04):
  • [48] Integrity check method for fine-grained data
    School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610031, China
    不详
    Ruan Jian Xue Bao, 2009, 4 (902-909):
  • [49] Fine-grained decomposition of complex digital twin systems driven by semantic-topological-dynamic associations
    Wen, Xiaojian
    Sun, Yicheng
    Liu, Shimin
    Bao, Jinsong
    Zhang, Dan
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 77 : 780 - 797
  • [50] Fine-Grained Queue Measurement in the Data Plane
    Chen, Xiaoqi
    Feibish, Shir Landau
    Koral, Yaron
    Rexford, Jennifer
    Rottenstreich, Ori
    Monetti, Steven A.
    Wang, Tzuu-Yi
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON EMERGING NETWORKING EXPERIMENTS AND TECHNOLOGIES (CONEXT '19), 2019, : 15 - 29