Automatic zipper tape defect detection using two-stage multi-scale convolutional networks

被引:22
作者
Fang, Houzhang [1 ]
Xia, Mingjiang [1 ]
Liu, Hehui [2 ]
Chang, Yi [3 ]
Wang, Liming [1 ]
Liu, Xiyang [1 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Software Engn Inst, Xian 710071, Peoples R China
[2] Nanjing Cognit Internet Things Res Inst, Nanjing 210001, Peoples R China
[3] Artificial Intelligence Res Ctr, Pengcheng Lab, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Automatic defect detection; Zipper tape inspection; Fully convolutional neural network; Feature fusion; Multi-scale detection;
D O I
10.1016/j.neucom.2020.09.046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Defects inevitably occur during the manufacturing process of the zipper, significantly affecting its value. Zipper inspection is of significant importance in ensuring the quality of the zipper products. Traditional zipper inspection requires skilled inspectors and is labor-intensive, inefficient, and inaccurate. Currently, automated zipper defects inspection with high precision and high efficiency is still very challenging. In this paper, we propose a novel zipper tape defect detection framework based on fully convolutional networks in a two-stage coarse-to-fine cascade manner. For our special application, the zipper tape defects have multi-scale characteristics. Most of the existing deep learning methods have great advantages in detecting the large-scale defects with prominent features, but are prone to fail in detecting the smallscale ones due to their less remarkable features as well as their general location in a large background area. Thus, we propose to detect first the large local context regions containing the small-scale defects using a multi-scale detection architecture with high efficiency, which integrates a new detection branch by fusing the features in the shallow layer into the high-level layer to boost the detection performance of the context regions. Then we finely detect the small-scale defects from the local context regions detected in the first stage, which can be regarded as large-scale objects that are more easily detected. Extensive comparative experiments demonstrate that the proposed method offers a high detection accuracy while still having high detection efficiency compared with the state-of-the-art methods, coupled with good robustness in some complex cases. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:34 / 50
页数:17
相关论文
共 33 条
[1]  
[Anonymous], ARXIV180402767V1
[2]   Fabric defect detection based on multiple fractal features and support vector data description [J].
Bu, Hong-gang ;
Wang, Jun ;
Huang, Xiu-bao .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2009, 22 (02) :224-235
[3]  
Cai ZX, 2019, MICRO NANO TECHNOL, P1, DOI 10.1016/B978-0-12-814497-8.00001-1
[4]   The PASCAL Visual Object Classes Challenge: A Retrospective [J].
Everingham, Mark ;
Eslami, S. M. Ali ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 111 (01) :98-136
[5]   Fabric defect detection systems and methods-A systematic literature review [J].
Hanbay, Kazim ;
Talu, Muhammed Fatih ;
Ozguven, Omer Faruk .
OPTIK, 2016, 127 (24) :11960-11973
[6]  
He KM, 2014, LECT NOTES COMPUT SC, V8691, P346, DOI [arXiv:1406.4729, 10.1007/978-3-319-10578-9_23]
[7]   Further Advantages of Data Augmentation on Convolutional Neural Networks [J].
Hernandez-Garcia, Alex ;
Koenig, Peter .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 :95-103
[8]  
Hu G., 2020, TEXTILE RES J, V90, P213
[9]   Automatic fabric defect detection using a deep convolutional neural network [J].
Jing, Jun-Feng ;
Ma, Hao ;
Zhang, Huan-Huan .
COLORATION TECHNOLOGY, 2019, 135 (03) :213-223
[10]  
Kumar A., 2002, IEEE P INT C IM PROC, V3