Multiscale Adversarial and Weighted Gradient Domain Adaptive Network for Data Scarcity Surface Defect Detection

被引:22
作者
Song, Yiguo [1 ]
Liu, Zhenyu [1 ]
Wang, Jiahui [1 ]
Tang, Ruining [1 ]
Duan, Guifang [1 ]
Tan, Jianrong [1 ]
机构
[1] Zhejiang Univ, State Key Lab Comp Aided Design & Comp Graph CAD, Hangzhou 310058, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Adversarial training; domain adaptation; machine vision; surface defect detection; INSPECTION;
D O I
10.1109/TIM.2021.3096284
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface defect detection is a challenging task in industrial manufacture. Recent methods using supervised learning need a large-scale dataset to achieve precise detection. However, the time-consuming and the difficulty of data acquisition make it difficult to build a large-scale dataset. This article proposes a domain adaptive network, called multiscale adversarial and weighted gradient domain adaptive network (MWDAN) for data scarcity surface defect detection. By MWDAN, the detection model trained from a small-scale dataset can gain the knowledge of transfer from another large-scale dataset, that is to say, even for a training dataset that is difficult to collect huge amounts of data, a good defect detection model can also be constructed, aided by another dataset that is relatively easy to acquire. The MWDAN is constructed in two levels. In the image level, a multiscale domain feature adaptation approach is proposed to solve the domain shift between the source domain and the target domain. In the instance level, a piecewise weighted gradient reversal layer (PWGRL) is designed to balance the weight of the backpropagation gradient for the hard- and easy-confused samples in domain classification and force confusion. Then, the PWGRI, can reduce the local instance difference to further promote domain consistency. The experiments on mental surface defect detection show encourage results by the proposed MWDAN method.
引用
收藏
页数:10
相关论文
共 39 条
[1]  
Aghdam S. R., 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA 2012). Proceedings, P1447, DOI 10.1109/ICIEA.2012.6360951
[2]   Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network [J].
Chen, Junwen ;
Liu, Zhigang ;
Wang, Hongrui ;
Nunez, Alfredo ;
Han, Zhiwei .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (02) :257-269
[3]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[4]   Domain Transfer Multiple Kernel Learning [J].
Duan, Lixin ;
Tsang, Ivor W. ;
Xu, Dong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (03) :465-479
[5]  
Ganin Y, 2015, PR MACH LEARN RES, V37, P1180
[6]   Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation [J].
Ghifary, Muhammad ;
Kleijn, W. Bastiaan ;
Zhang, Mengjie ;
Balduzzi, David ;
Li, Wen .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :597-613
[7]  
Gong BQ, 2012, PROC CVPR IEEE, P2066, DOI 10.1109/CVPR.2012.6247911
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   A Fully Convolutional Neural Network for Wood Defect Location and Identification [J].
He, Ting ;
Liu, Ying ;
Xu, Chengyi ;
Zhou, Xiaolin ;
Hu, Zhongkang ;
Fan, Jianan .
IEEE ACCESS, 2019, 7 :123453-123462
[10]   An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features [J].
He, Yu ;
Song, Kechen ;
Meng, Qinggang ;
Yan, Yunhui .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (04) :1493-1504