Enhancing titanium spacer defect detection through reinforcement learning-optimized digital twin and synthetic data generation

被引:2
作者
Mohanty, Sankarsan [1 ]
Su, Eugene [2 ]
Ho, Chao-Ching [1 ,2 ]
机构
[1] Natl Taipei Univ Technol, Mech & Automat Engn, Taipei, Taiwan
[2] Natl Taipei Univ Technol, Grad Inst Mfg Technol, Taipei, Taiwan
关键词
digital twin; reinforcement learning; synthetic data; automated optical inspection; convolutional neural network; spacer ring; NETWORKS;
D O I
10.1117/1.JEI.33.1.013021
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the field of automatic defect detection, a major challenge in training accurate classifiers using supervised learning is the insufficient and limited diversity of datasets. Obtaining an adequate amount of image data depicting defective surfaces in an industrial setting can be costly and time-consuming. Furthermore, the collected dataset may suffer from selection bias, resulting in an underrepresentation of certain defect classes. Our research aims to address surface defect detection in titanium metal spacer rings by introducing an approach leveraging a digital twin framework. The behavior of the digital twin is optimized using a reinforcement learning (RL) algorithm. The optimized digital twin is then used to generate synthetic data, which is employed to train a spacer defect detection classifier. The classifier's performance is evaluated using real-world data. The results show that the model trained with synthetic data outperforms the one trained on a limited amount of real data. Our work highlights the potential of digital twin-based synthetic data generation and RL optimization in enhancing spacer surface defect detection and addressing the data scarcity challenge in the field. When the inspection network is trained solely using generated synthetic data, it achieves an inspection precision of 96.10%, with a recall of 85.77%. Incorporating real data alongside synthetic data for training further enhances performance, yielding an inspection precision of 93.07% and a recall of 94.20%. This surpasses the defect detection capabilities observed when training the inspection network exclusively with real data.
引用
收藏
页数:25
相关论文
共 31 条
[1]  
Alemohammad S, 2023, Arxiv, DOI [arXiv:2307.01850, DOI 10.48550/ARXIV.2307.01850]
[2]   Synthetic Data Generation for Steel Defect Detection and Classification Using Deep Learning [J].
Boikov, Aleksei ;
Payor, Vladimir ;
Savelev, Roman ;
Kolesnikov, Alexandr .
SYMMETRY-BASEL, 2021, 13 (07)
[3]  
Borkman S., 2021, arXiv
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]   Synthesizing Industrial Defect Images Under Data Imbalance [J].
Cho, Eunhee ;
Jeon, Byeonghwan ;
Park, In Kyu .
IEEE ACCESS, 2023, 11 :111335-111346
[6]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[7]  
Denninger M, 2019, Arxiv, DOI arXiv:1911.01911
[8]   An attempt to simulate structure and realistic images of scratches on rough polymeric surfaces [J].
Gao, Weimin ;
Wang, Lijing ;
Coffey, Jolanta K. ;
Wu, Hongren ;
Daver, Fugen .
JOURNAL OF POLYMER SCIENCE, 2020, 58 (22) :3209-3218
[9]   Synthetic training data generation for deep learning based quality inspection [J].
Gutierrez, Pierre ;
Luschkova, Maria ;
Cordier, Antoine ;
Shukor, Mustafa ;
Schappert, Mona ;
Dahmen, Tim .
FIFTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2021, 11794
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778