Machine vision-based defect detection method for sewing stitch traces

被引:0
作者
Chen, Yufan [1 ]
Zheng, Xiaohu [2 ,3 ,4 ]
Xu, Xuliang [5 ]
Liu, Bing [6 ]
机构
[1] College of Information Science and Technology, Donghua University, Shanghai
[2] Institute of Artificial Intelligence, Donghua University, Shanghai
[3] Engineering Research Center of Artificial Intelligence for Textile Industry, Ministry of Education, Shanghai
[4] Shanghai Industrial Big Data and Intelligent Systems Engineering Technology Center, Shanghai
[5] HIKARI (Shanghai) Precise Machinery Scientific & Technology Co., Ltd., Shanghai
[6] Hangzhou Zhongfu Technology & Innovation Research Institute Co., Ltd., Zhejiang, Hangzhou
来源
Fangzhi Xuebao/Journal of Textile Research | 2024年 / 45卷 / 07期
关键词
anomaly detection; DeblurGAN; -; v2; machine vision; sewing thread defect detection; student-teacher feature pyramid matching;
D O I
10.13475/j.fzxb.20230708401
中图分类号
学科分类号
摘要
Objective In order to solve the problems of slow speed, low efficiency, and high cost in conventional manual quality inspection methods for sewing thread, this study proposes a machine vision-based method for sewing thread defect detection in seams. This study aims to achieve fast, accurate, and automated identification of common defects such as cast thread, jumper thread, and broken thread in seams. This study also highlights the importance and necessity of improving product quality and production efficiency in the textile and garment industry.Method This study adopts a two-step approach for defect detection. Firstly, a low-cost array camera was adopted to capture real-time images of the sewing seam and the DeblurGAN-v2 method was employed to remove motion blurriness from the images, aiming at improving image clarity. Secondly, the student-teacher feature pyramid matching method was applied for anomaly detection, which transfers the knowledge from a pre-trained ResNet-34 model as the teacher network to a student network with the same architecture, so as to learn the distribution of normal images. By comparing the differences between the feature pyramids generated by the two networks as a scoring method, the defect detection system made decisions on whether the image has anomalies, and marked the abnormal areas with a heat distribution map.Results The defects of flat stiteh fabric and overstitch fabric were tested and the performance of the proposed method was evaluated in terms of recall and accuracy rates. The results show that the proposed method can effectively detect various sewing thread defects and has high recall and accuracy rates for different types of defects. This study also provided some examples of defect detection results and scores for different types of defects. Conclusion The feature pyramid matching technique is applied in the field of stitch trace detection. By adding the difficult sample mining technology, the average detection accuracy is increased to more than 95%, and the detection speed of a single image is less than 0. 04 s. Aiming at image motion blur ring caused by jitter and fast movement. The DeblurGAN-v2 framework is used as the framework of deblurring algorithm, and the blueprint convolution is added to change the backbone network, and the processing speed of a single image is kept below 0. 06 s. The model has excellent interference resistance and high processing speed, and can meet the requirement of stitch trace recognition. © 2024 China Textile Engineering Society. All rights reserved.
引用
收藏
页码:173 / 180
页数:7
相关论文
共 18 条
[1]  
WU Liubo, LI Xinrong, DU Jinli, Research progress of motion trajectory planning of sewing robot based on contour extraction, Journal of Textile Research, 42, 4, pp. 191-200, (2021)
[2]  
LU Hao, CHEN Yuan, A method for surface defect detection of carbon filler prepreg based on machine vision, Journal of Textile Research, 41, 4, pp. 51-57, (2020)
[3]  
FANG B, LONG X, SUN F, Et al., Tactile-based fabric defect detection using convolutional neural network with attention mechanism [J], IEEE Transactions on Instrumentation and Measurement, 71, pp. 1-9, (2022)
[4]  
ABATI D, PORRELLO A, CALDERARA S, Et al., Latent space autoregression for novelty detection, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 481-490, (2019)
[5]  
WANG G, HAN S, DING E, Et al., Student-teacher feature pyramid matching for unsupervised anomaly detection, (2021)
[6]  
BERGMANN P, FAUSER M, SATTLEGGER D, Et al., Uninformed students
[7]  
student-teacher anomaly detection with discriminative latent embeddings, 2020 IEEE/ CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4183-4192, (2020)
[8]  
KIM J H, KIM N, PARK Y W, Et al., Object detection and classification based on Y0L0v5 with improved maritime dataset, Journal of Marine Science and Engineering, 10, 3, (2022)
[9]  
REN S, HE K, GIRSHICK R, Et al., Faster R-CNN: towards real-time object detection with region proposal networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 6, pp. 1137-1149, (2017)
[10]  
ROZUMNYI D, OSWALD MR, FERRARI V, Et al., Defmo