Narrow gap GTAW defect detection and classification based on transfer learning of generative adversarial networks

被引:3
作者
Yu, Zhengxiao [1 ]
Ma, Ninshu [1 ]
Lu, Hao [2 ]
Yang, Hetong [3 ]
Liu, Weihua [3 ]
Li, Ye [4 ]
机构
[1] Osaka Univ, Joining & Welding Res Inst, Osaka 5670047, Japan
[2] Shanghai Jiao Tong Univ, Sch Mat Sci & Engn, Shanghai 200240, Peoples R China
[3] China Nucl Ind Fifth Construct Co LTD, Shanghai 201512, Peoples R China
[4] Taiyuan Univ Sci & Technol, Taiyuan 030024, Peoples R China
基金
中国国家自然科学基金;
关键词
Narrow gap GTAW; Transfer learning; Welding defects; Classification; WELD PENETRATION;
D O I
10.1016/j.jmapro.2024.10.047
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Gas tungsten arc welding (GTAW) is the primary process employed for critical applications such as pressure vessels and power pipelines where the weld quality and integrity are essential. Traditionally, its quality and integrity heavily rely on engineers' experience to assess because the phenomena involved are extremely complex to interpret. Deep learning can significantly enhance the efficiency. However, acquiring a sufficient number of correct defect features during actual production presents a challenge. To address this issue, this study first analyzed the narrow GTAW process to identify suitable phenomenon that fundamentally correlates to the relevant defects. To mathematically explain these complex relationships, we explored two classification networks, ResNet and Vision Transformer (VIT), as potentially most effective network structures to filter image features from a public aluminum alloy GTAW database for transfer learning. Additionally, a Generative Adversarial Network (GAN) was utilized to generate defect feature images. Transfer learning from the public database and GAN-generated image features substantially improved the model's prediction accuracy. Validation on the test set revealed that the pre-trained GAN-generated images support the model achieved the best F1 score and accuracy, at 92.78 % and 92.8 %, respectively.
引用
收藏
页码:2350 / 2364
页数:15
相关论文
共 32 条
[1]   Tomato plant disease detection using transfer learning with C-GAN synthetic images [J].
Abbas, Amreen ;
Jain, Sweta ;
Gour, Mahesh ;
Vankudothu, Swetha .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 187
[2]   Automated defect classification of Aluminium 5083 TIG welding using HDR camera and neural networks [J].
Bacioiv, Daniel ;
Melton, Geoff ;
Papaelias, Mayorkinos ;
Shaw, Rob .
JOURNAL OF MANUFACTURING PROCESSES, 2019, 45 (603-613) :603-613
[3]   In-process prediction of weld penetration depth using machine learning-based molten pool extraction technique in tungsten arc welding [J].
Baek, Daehyun ;
Moon, Hyeong Soon ;
Park, Sang-Hu .
JOURNAL OF INTELLIGENT MANUFACTURING, 2024, 35 (01) :129-145
[4]   Multi-scale Single Image Super-Resolution with Remote-Sensing Application Using Transferred Wide Residual Network [J].
Deeba, Farah ;
Zhou, Yuanchun ;
Dharejo, Fayaz Ali ;
Du, Yi ;
Wang, Xuezhi ;
Kun, She .
WIRELESS PERSONAL COMMUNICATIONS, 2021, 120 (01) :323-342
[5]  
Dosovitskiy A, 2020, An image is worth 16x16 words: transformers for image recognition at scale, DOI [10.48550/arXiv2010.11929, DOI 10.48550/ARXIV2010.11929]
[6]   Forming force prediction in double-sided incremental forming via GNN-based transfer learning [J].
Duan, Songlin ;
Kozjek, Dominik ;
Mehr, Edward ;
Anders, Mark ;
Cao, Jian .
JOURNAL OF MANUFACTURING PROCESSES, 2024, 120 :867-877
[7]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[8]   A Survey on Vision Transformer [J].
Han, Kai ;
Wang, Yunhe ;
Chen, Hanting ;
Chen, Xinghao ;
Guo, Jianyuan ;
Liu, Zhenhua ;
Tang, Yehui ;
Xiao, An ;
Xu, Chunjing ;
Xu, Yixing ;
Yang, Zhaohui ;
Zhang, Yiman ;
Tao, Dacheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) :87-110
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Neurofuzzy model-based weld fusion state estimation [J].
Kovacevic, R ;
Zhang, YM .
IEEE CONTROL SYSTEMS MAGAZINE, 1997, 17 (02) :30-42