A Novel Data Augmentation Method for Improved Visual Crack Detection Using Generative Adversarial Networks

被引:32
作者
Branikas, Efstathios [1 ]
Murray, Paul [1 ]
West, Graeme [1 ]
机构
[1] Univ Strathclyde, Dept Elect & Elect Engn, Glasgow G1 1XQ, Scotland
关键词
Generative adversarial networks; Inspection; Image segmentation; Visualization; Task analysis; Data models; Data augmentation; Crack segmentation; generative adversarial networks (GANs); nuclear inspections; data augmentation; image-to-image translation; FAULT-DETECTION; CLASSIFICATION; INSPECTION;
D O I
10.1109/ACCESS.2023.3251988
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Condition monitoring and inspection are core activities for assessing and evaluating the health of critical infrastructure spanning from road networks to nuclear power stations. Defect detection on visual inspections of such assets is a field that enjoys increasing attention. However, data-based models are prone to a lack of available data depicting cracks of various modalities and present a great data imbalance. This paper introduces a novel data augmentation technique by deploying the CycleGan Generative Adversarial Network (GAN). The proposed model is deployed between different image datasets depicting cracks, with a nuclear application as the main industrial example. The aim of this network is to improve the segmentation accuracy on these datasets using deep convolutional neural networks. The proposed GAN generates realistic images that are challenging to segment and under-represented in the original datasets. Different deep networks are trained with the augmented datasets while introducing no labelling overhead. A comparison is drawn between the performance of the different neural networks on the original data and their augmented counterparts. Extensive experiments suggest that the proposed augmentation method results in superior crack detection in challenging cases across all datasets. This is reflected by the respective increase in the quantitative evaluation metrics.
引用
收藏
页码:22051 / 22059
页数:9
相关论文
共 50 条
[21]   Seismic Data Augmentation Based on Conditional Generative Adversarial Networks [J].
Li, Yuanming ;
Ku, Bonhwa ;
Zhang, Shou ;
Ahn, Jae-Kwang ;
Ko, Hanseok .
SENSORS, 2020, 20 (23) :1-13
[22]   Data augmentation through multivariate scenario forecasting in Data Centers using Generative Adversarial Networks [J].
Jaime Pérez ;
Patricia Arroba ;
José M. Moya .
Applied Intelligence, 2023, 53 :1469-1486
[23]   Data augmentation through multivariate scenario forecasting in Data Centers using Generative Adversarial Networks [J].
Perez, Jaime ;
Arroba, Patricia ;
Moya, Jose M. .
APPLIED INTELLIGENCE, 2023, 53 (02) :1469-1486
[24]   Efficient Classification of Imbalanced Natural Disasters Data Using Generative Adversarial Networks for Data Augmentation [J].
Eltehewy, Rokaya ;
Abouelfarag, Ahmed ;
Saleh, Sherine Nagy .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2023, 12 (06)
[25]   DATA AUGMENTATION FOR LAND COVER CLASSIFICATION USING GENERATIVE ADVERSARIAL NETWORKS [J].
Kamel, Aouaidjia ;
Issam, Boukerch .
2021 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM IGARSS, 2021, :2309-2312
[26]   Data augmentation for handwritten digit recognition using generative adversarial networks [J].
Jha, Ganesh ;
Cecotti, Hubert .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (47-48) :35055-35068
[27]   Data augmentation for handwritten digit recognition using generative adversarial networks [J].
Ganesh Jha ;
Hubert Cecotti .
Multimedia Tools and Applications, 2020, 79 :35055-35068
[28]   Studying the Applicability of Generative Adversarial Networks on HEp-2 Cell Image Augmentation [J].
Anaam, Asaad ;
Bu-Omer, Hani M. ;
Gofuku, Akio .
IEEE ACCESS, 2021, 9 :98048-98059
[29]   Robust Data Augmentation Generative Adversarial Network for Object Detection [J].
Lee, Hyungtak ;
Kang, Seongju ;
Chung, Kwangsue .
SENSORS, 2023, 23 (01)
[30]   PIXEL LEVEL DATA AUGMENTATION FOR SEMANTIC IMAGE SEGMENTATION USING GENERATIVE ADVERSARIAL NETWORKS [J].
Liu, Shuangting ;
Zhang, Jiaqi ;
Chen, Yuxin ;
Liu, Yifan ;
Qin, Zengchang ;
Wan, Tao .
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, :1902-1906