Complex Pattern Jacquard Fabrics Defect Detection Using Convolutional Neural Networks and Multispectral Imaging

被引:15
作者
Khodier, Mahmoud M. [1 ]
Ahmed, Sabah M. [2 ,3 ]
Sayed, Mohammed Sharaf [1 ,4 ]
机构
[1] Egypt Japan Univ Sci & Technol, Dept Elect & Commun Engn, Alexandria 21934, Egypt
[2] Egypt Japan Univ Sci & Technol, Dept Mechatron & Robot Engn, Alexandria 21934, Egypt
[3] Assiut Univ, Fac Engn, Dept Elect Engn, Alexandria 71515, Egypt
[4] Zagazig Univ, Dept Elect & Commun Engn, Zagazig 44519, Egypt
来源
IEEE ACCESS | 2022年 / 10卷 / 10653-10660期
关键词
Fabrics; Yarn; Inspection; Multispectral imaging; Convolutional neural networks; Weaving; Production; Complex patterns; convolutional neural networks; fabric defect detection; jacquard; multispectral imaging; SEGMENTATION;
D O I
10.1109/ACCESS.2022.3144843
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Manual inspection of textiles is a long, tedious, and costly method. Technology has solved this problem by developing automatic systems for textile inspection. However, Jacquard fabrics present a challenge because patterns can be complex and seemingly random to systems. Only a few in-depth studies have been conducted on jacquard fabrics despite their important and intriguing nature. Previous studies on jacquard fabrics are of simple patterns. This paper introduces a new and novel field in fabrics defect detection. Complex-patterned jacquard fabrics are much more challenging. In this paper, novel defect detection models for jacquard-patterned fabrics are presented. Owing to the lack of available databases for jacquard fabrics, we compiled and experimented on our own novel dataset. Our dataset was collected from plain, undyed jacquard fabrics with different complex patterns. In this study, we used and tested several deep learning models with image pre-processing and convolutional neural networks (CNNs) for unsupervised detection of defects. We also used multispectral imaging, combining normal (RGB) and near-infrared (NIR) imaging to improve our system and increase its accuracy. We propose two systems: a semi-manual system using a simple CNN network for operation on separate patterns and an integrated automated system that uses state-of-the-art CNN architectures to run on the entire dataset without prior pattern specification. The images are preprocessed using contrast-limited adaptive Histogram Equalization (CLAHE) to enhance their features. We concluded that deep learning is efficient and can be used for defect detection in complex patterns. Proposed method of EfficientNet CNN gave high accuracy reaching 99% approximately. We also found that multispectral imaging is more advantageous and yields higher accuracy.
引用
收藏
页码:10653 / 10660
页数:8
相关论文
共 32 条
[1]  
cloud.google, ADV GUIDE INCEPTIONV
[2]  
Feng Z., 2005, ROUGH SETS FUZZY SET, V3642, DOI [10.1007/11548706_29, DOI 10.1007/11548706_29]
[3]  
Feng ZL, 2004, PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON INTELLIGENT MECHATRONICS AND AUTOMATION, P617
[4]  
Ferguson M., 2017, 2017 IEEE INT C BIG, P1726, DOI DOI 10.1109/BIGDATA.2017.8258115
[5]   Fabric defect detection based on the saliency map construction of target-driven feature [J].
Guan, Shengqi ;
Shi, Hongyu .
JOURNAL OF THE TEXTILE INSTITUTE, 2018, 109 (09) :1133-1142
[6]  
Hamdi Azhar A., 2017, 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS). Proceedings, P111, DOI 10.1109/INTELCIS.2017.8260041
[7]   Fabric defect detection systems and methods-A systematic literature review [J].
Hanbay, Kazim ;
Talu, Muhammed Fatih ;
Ozguven, Omer Faruk .
OPTIK, 2016, 127 (24) :11960-11973
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Ioffe Sergey, 2015, P MACHINE LEARNING R, V37, P448
[10]  
Jiang GM, 2014, FIBRES TEXT EAST EUR, V22, P53