Development of a real-time machine vision system for functional textile fabric defect detection using a deep YOLOv4 model

被引:40
作者
Dlamini, Sifundvolesihle [1 ]
Kao, Chih-Yuan [2 ]
Su, Shun-Lian [2 ]
Jeffrey Kuo, Chung-Feng [1 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Mat Sci & Engn, 43,Keelung Rd,Sect 4, Taipei 106, Taiwan
[2] BenQ Mat Corp, Machine Vis Dept, Taoyuan, Taiwan
关键词
Functional textile; defect detection; machine vision; real time; YOLOv4; NEURAL-NETWORK; TEXTURE; INSPECTION; FOURIER;
D O I
10.1177/00405175211034241
中图分类号
TB3 [工程材料学]; TS1 [纺织工业、染整工业];
学科分类号
0805 ; 080502 ; 0821 ;
摘要
We introduce a real-time machine vision system we developed with the aim of detecting defects in functional textile fabrics with good precision at relatively fast detection speeds to assist in textile industry quality control. The system consists of image acquisition hardware and image processing software. The software we developed uses data preprocessing techniques to break down raw images to smaller suitable sizes. Filtering is employed to denoise and enhance some features. To generalize and multiply the data to create robustness, we use data augmentation, which is followed by labeling where the defects in the images are labeled and tagged. Lastly, we utilize YOLOv4 for localization where the system is trained with weights of a pretrained model. Our software is deployed with the hardware that we designed to implement the detection system. The designed system shows strong performance in defect detection with precision of 95.3 % , and recall and F 1 scores of 93.6 % and 94.4 % , respectively. The detection speed is relatively fast at 34 fps with a prediction speed of 21.4 ms. Our system can automatically locate functional textile fabric defects with high confidence in real time.
引用
收藏
页码:675 / 690
页数:16
相关论文
共 64 条
  • [1] Melanoma Lesion Detection and Segmentation Using YOLOv4-DarkNet and Active Contour
    Albahli, Saleh
    Nida, Nudrat
    Irtaza, Aun
    Yousaf, Muhammad Haroon
    Mahmood, Muhammad Tariq
    [J]. IEEE ACCESS, 2020, 8 (08): : 198403 - 198414
  • [2] Texture Modeling Using Contourlets and Finite Mixtures of Generalized Gaussian Distributions and Applications
    Allili, Mohand Said
    Baaziz, Nadia
    Mejri, Marouene
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (03) : 772 - 784
  • [3] Antoniou A., 2017, ARXIV171104340
  • [4] Bochkovskiy A., 2020, YOLOv4: Optimal Speed and Accuracy of Object Detection, DOI DOI 10.48550/ARXIV.2004.10934
  • [5] Bodnarova A, 1998, IEEE SYS MAN CYBERN, P4423, DOI 10.1109/ICSMC.1998.727546
  • [6] High-dimensional data clustering
    Bouveyron, C.
    Girard, S.
    Schmid, C.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 52 (01) : 502 - 519
  • [7] Campell, 1997, INFM97004
  • [8] Carlueho J, 2018, IEEE INT C INT ROBOT, P2336, DOI 10.1109/IROS.2018.8594067
  • [9] Fabric defect detection by Fourier analysis
    Chan, CH
    Pang, GKH
    [J]. IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2000, 36 (05) : 1267 - 1276
  • [10] AUTOMATED INSPECTION OF TEXTILE FABRICS USING TEXTURAL MODELS
    COHEN, FS
    FAN, ZG
    ATTALI, S
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1991, 13 (08) : 803 - 808