A Novel Data Augmentation Method for Improved Visual Crack Detection Using Generative Adversarial Networks

被引:31
作者
Branikas, Efstathios [1 ]
Murray, Paul [1 ]
West, Graeme [1 ]
机构
[1] Univ Strathclyde, Dept Elect & Elect Engn, Glasgow G1 1XQ, Scotland
关键词
Generative adversarial networks; Inspection; Image segmentation; Visualization; Task analysis; Data models; Data augmentation; Crack segmentation; generative adversarial networks (GANs); nuclear inspections; data augmentation; image-to-image translation; FAULT-DETECTION; CLASSIFICATION; INSPECTION;
D O I
10.1109/ACCESS.2023.3251988
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Condition monitoring and inspection are core activities for assessing and evaluating the health of critical infrastructure spanning from road networks to nuclear power stations. Defect detection on visual inspections of such assets is a field that enjoys increasing attention. However, data-based models are prone to a lack of available data depicting cracks of various modalities and present a great data imbalance. This paper introduces a novel data augmentation technique by deploying the CycleGan Generative Adversarial Network (GAN). The proposed model is deployed between different image datasets depicting cracks, with a nuclear application as the main industrial example. The aim of this network is to improve the segmentation accuracy on these datasets using deep convolutional neural networks. The proposed GAN generates realistic images that are challenging to segment and under-represented in the original datasets. Different deep networks are trained with the augmented datasets while introducing no labelling overhead. A comparison is drawn between the performance of the different neural networks on the original data and their augmented counterparts. Extensive experiments suggest that the proposed augmentation method results in superior crack detection in challenging cases across all datasets. This is reflected by the respective increase in the quantitative evaluation metrics.
引用
收藏
页码:22051 / 22059
页数:9
相关论文
共 28 条
[1]   Anomaly Detection and Automatic Labeling for Solar Cell Quality Inspection Based on Generative Adversarial Network [J].
Balzategui, Julen ;
Eciolaza, Luka ;
Maestro-Watson, Daniel .
SENSORS, 2021, 21 (13)
[2]  
Branikas E., 2021, PROC 12 NUCL PLANT I, P1
[3]   SDDNet: Real-Time Crack Segmentation [J].
Choi, Wooram ;
Cha, Young-Jin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (09) :8016-8025
[4]   Fault Detection and Classification for Photovoltaic Systems Based on Hierarchical Classification and Machine Learning Technique [J].
Eskandari, Aref ;
Milimonfared, Jafar ;
Aghaei, Mohammadreza .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (12) :12750-12759
[5]   Current-Based Mechanical Fault Detection for Direct-Drive Wind Turbines via Synchronous Sampling and Impulse Detection [J].
Gong, Xiang ;
Qiao, Wei .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (03) :1693-1702
[6]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[7]   Surface defect classification of steels with a new semi-supervised learning method [J].
He Di ;
Xu Ke ;
Zhou Peng ;
Zhou Dongdong .
OPTICS AND LASERS IN ENGINEERING, 2019, 117 :40-48
[8]   Unsupervised fabric defect detection based on a deep convolutional generative adversarial network [J].
Hu, Guanghua ;
Huang, Junfeng ;
Wang, Qinghui ;
Li, Jingrong ;
Xu, Zhijia ;
Huang, Xingbiao .
TEXTILE RESEARCH JOURNAL, 2020, 90 (3-4) :247-270
[9]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[10]  
Jenkins MD, 2018, EUR SIGNAL PR CONF, P2120, DOI 10.23919/EUSIPCO.2018.8553280