Road damage detection with bounding box and generative adversarial networks based augmentation methods

被引:9
作者
Aghayan-Mashhady, Nima [1 ]
Amirkhani, Abdollah [1 ]
机构
[1] Iran Univ Sci & Technol, Sch Automot Engn, Tehran 1684613114, Iran
关键词
convolutional neural nets; image annotation; object detection; road vehicles; IMAGE QUALITY ASSESSMENT; DEEP NEURAL-NETWORKS; CRACK DETECTION;
D O I
10.1049/ipr2.12940
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, based on the data augmentation techniques of bounding box augmentation and the road damage generative adversarial network based augmentation, a robust road damage detection method has been presented. To this end, first, Iran road damage dataset has been collected by means of a dashboard-installed mobile phone. After processing these images by the blind referenceless image spatial quality evaluator technique, the substandard and inferior data have been automatically eliminated. In the second step, based on the YOLOv5 with several different baseline models, an algorithm has been developed for detecting the road surface damages. In the third step, by using the traditional as well as the bounding box augmentation and road damage generative adversarial network based augmentation techniques, the precision and the robustness of road damage detector under different environmental and field conditions have been improved. Finally, through the ensemble of the best models, the final detector accuracy has been enhanced. The findings of this article indicate that by using the proposed approach, the values of mAP and F1-score are improved by 13.79% and 7.58%, respectively. The dataset and parts of the code are available at: . In this research, based on the data augmentation techniques of bounding box augmentation and the road damage generative adversarial network based augmentation, a robust road damage detection method has been presented. To this end, first, Iran road damage dataset has been collected .The findings of this paper indicate that by using the proposed approach, the values of mAP and F1-score are improved by 13.79% and 7.58%, respectively.image
引用
收藏
页码:154 / 174
页数:21
相关论文
共 75 条
[1]  
Alfarrarjeh A, 2018, IEEE INT CONF BIG DA, P5201, DOI 10.1109/BigData.2018.8621899
[2]   Attention-based generative adversarial network with internal damage segmentation using thermography [J].
Ali, Rahmat ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2022, 141
[3]   A survey on adversarial attacks and defenses for object detection and their applications in autonomous vehicles [J].
Amirkhani, Abdollah ;
Karimi, Mohammad Parsa ;
Banitalebi-Dehkordi, Amin .
VISUAL COMPUTER, 2023, 39 (11) :5293-5307
[4]  
Anandhalli M, 2022, INT J INF TECHNOL, V14, P3343
[5]   Road Damage Detection Acquisition System Based on Deep Neural Networks for Physical Asset Management [J].
Angulo, Andres ;
Vega-Fernandez, Juan Antonio ;
Aguilar-Lobo, Lina Maria ;
Natraj, Shailendra ;
Ochoa-Ruiz, Gilberto .
ADVANCES IN SOFT COMPUTING, MICAI 2019, 2019, 11835 :3-14
[6]  
[Anonymous], 2015, COMP VISUAL MEDIA
[7]   Deep learning-based road damage detection and classification for multiple countries [J].
Arya, Deeksha ;
Maeda, Hiroya ;
Ghosh, Sanjay Kumar ;
Toshniwal, Durga ;
Mraz, Alexander ;
Kashiyama, Takehiro ;
Sekimoto, Yoshihide .
AUTOMATION IN CONSTRUCTION, 2021, 132
[8]   RDD2020: An annotated image dataset for automatic road damage detection using deep learning [J].
Arya, Deeksha ;
Maeda, Hiroya ;
Ghosh, Sanjay Kumar ;
Toshniwal, Durga ;
Sekimoto, Yoshihide .
DATA IN BRIEF, 2021, 36
[9]   Global Road Damage Detection: State-of-the-art Solutions [J].
Arya, Deeksha ;
Maeda, Hiroya ;
Ghosh, Sanjay Kumar ;
Toshniwal, Durga ;
Omata, Hiroshi ;
Kashiyama, Takehiro ;
Sekimoto, Yoshihide .
2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, :5533-5539
[10]   Encoder-decoder network for pixel-level road crack detection in black-box images [J].
Bang, Seongdeok ;
Park, Somin ;
Kim, Hongjo ;
Kim, Hyoungkwan .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2019, 34 (08) :713-727