U-SMR: U-SwinT & multi-residual network for fabric defect detection

被引:7
作者
Qu, Hao [1 ]
Di, Lan [1 ]
Liang, Jiuzhen [2 ]
Liu, Hao [2 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp, Wuxi 214122, Peoples R China
[2] Changzhou Univ, Sch Comp Sci & Artificial Intelligence, Changzhou 213164, Peoples R China
关键词
Fabric defect detection; U-SMR net; Swin transformer; Dual-branch pyramid module; Recursive multi-residuals; SALIENT OBJECT DETECTION;
D O I
10.1016/j.engappai.2023.107094
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Fabric defect detection methods based on deep networks are widely used in the textile industry, but they often suffer from poor model generalization and blurry edge detection. To resolve these challenges, we propose a novel network called "U-SMR Net", which integrates global contextual features, defect detail features, and high-level semantic features through the combination of ResNet-50 and Swin Transformer modules. Our USMR network includes a lightweight multiscale feature extraction module, the dual-branch pyramid Module (DBPM), which is nested to preserve high-resolution, shallow semantic information. We propose a recursive multi-level residual decoding block for multiscale fusion to refine, filter, and enhance input characteristics, generating prediction maps at multiple stages, and by employing an improved binary cross entropy loss function to supervise saliency mapping. The experimental results based on four groups from ZJU-Leaper dataset demonstrate the superior performance of our approach compared to other competitive methods by achieving an average fmeav ������e score of 75.33%, and finally testing results from both ZJU-Leaper-Total dataset and the HKU-Fabric dataset further support our U-SMR Net's validity and generalization ability.
引用
收藏
页数:14
相关论文
共 51 条
[11]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[12]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[13]   Deeply Supervised Salient Object Detection with Short Connections [J].
Hou, Qibin ;
Cheng, Ming-Ming ;
Hu, Xiaowei ;
Borji, Ali ;
Tu, Zhuowen ;
Torr, Philip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5300-5309
[14]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[15]  
Hussain T, 2021, Arxiv, DOI arXiv:2102.06407
[16]   Model Level Ensemble for Facial Action Unit Recognition at the 3rd ABAW Challenge [J].
Jiang, Wenqiang ;
Wu, Yannan ;
Qiao, Fengsheng ;
Meng, Liyu ;
Deng, Yuanyuan ;
Liu, Chuanhe .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :2336-2343
[17]   Mobile-Unet: An efficient convolutional neural network for fabric defect detection [J].
Jing, Junfeng ;
Wang, Zhen ;
Ratsch, Matthias ;
Zhang, Huanhuan .
TEXTILE RESEARCH JOURNAL, 2022, 92 (1-2) :30-42
[18]   Recursive Contour-Saliency Blending Network for Accurate Salient Object Detection [J].
Ke, Yun Yi ;
Tsubono, Takahiro .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :1360-1370
[19]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[20]   Loss Function Approaches for Multi-label Music Tagging [J].
Knox, Dillon ;
Greer, Timothy ;
Ma, Benjamin ;
Kuo, Emily ;
Somandepalli, Krishna ;
Narayanan, Shrikanth .
2021 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2021, :191-194