A Graph Guided Convolutional Neural Network for Surface Defect Recognition

被引:22
作者
Wang, Yucheng [1 ]
Gao, Liang [1 ]
Gao, Yiping [1 ]
Li, Xinyu [1 ]
机构
[1] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Sch Mech Sci & Engn, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolutional neural networks; Training; Surface treatment; Computational modeling; Costs; Data mining; Manufacturing automation; surface defect recognition; graph guidance; convolutional neural network; LEARNING-BASED APPROACH; LOCAL BINARY PATTERNS; CLASSIFICATION; INSPECTION;
D O I
10.1109/TASE.2022.3140784
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Surface defect is a serious problem in real-world manufacturing system and it is important to use vision-based recognition to ensure the surface quality of products. Currently, due to the ability of automatic feature extraction, deep learning models, such as convolutional neural network (CNN), have been widely used in this area. However, these CNN-based models may not solve a problem well - inter-class similarities and intra-class variations (ISIV), which affect their ability of feature extraction and thus influence their recognition performance. To address this problem, this paper introduces a graph guidance mechanism into CNN to improve the ability of feature extraction, called Graph guided Convolutional Neural Network (GCNN). Firstly, GCNN defines a graph by computing the similarities between training samples. Secondly, the graph is introduced into VGG11, a popular CNN structure, to increase the inter-class distances and decrease the intra-class distances between defect samples. Meanwhile, a learnable coefficient is introduced into the training process to balance the effect of graph guidance automatically. The experimental results on four famous surface defect datasets demonstrate that the graph guidance helps CNN models have better ability of feature extraction and thus achieve better performance. Compared with state-of-the-art models, the proposed method can achieve the best performance. Furthermore, the final discussion shows that the learnable coefficient can help the proposed model to gain better performance, and that the proposed model increases a little computation cost compared to its original CNN model.
引用
收藏
页码:1392 / 1404
页数:13
相关论文
共 47 条
[1]   Image-based defect detection in lithium-ion battery electrode using convolutional neural networks [J].
Badmos, Olatomiwa ;
Kopp, Andreas ;
Bernthaler, Timo ;
Schneider, Gerhard .
JOURNAL OF INTELLIGENT MANUFACTURING, 2020, 31 (04) :885-897
[2]  
Belkhir N., TEXTILE DEFECT DETEC
[3]   Nickel foam surface defect detection based on spatial-frequency multi-scale MB-LBP [J].
Cao, Bin-fang ;
Li, Jian-qi ;
Qiao, Nao-sheng .
SOFT COMPUTING, 2020, 24 (08) :5949-5957
[4]   Solar cell surface defect inspection based on multispectral convolutional neural network [J].
Chen, Haiyong ;
Pang, Yue ;
Hu, Qidi ;
Liu, Kun .
JOURNAL OF INTELLIGENT MANUFACTURING, 2020, 31 (02) :453-468
[5]   A New Ensemble Approach based on Deep Convolutional Neural Networks for Steel Surface Defect classification [J].
Chen, Wen ;
Gao, Yiping ;
Gao, Liang ;
Li, Xinyu .
51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 :1069-1072
[6]   Vision-based online process control in manufacturing applications [J].
Cheng, Yuan ;
Jafari, Mohsen A. .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2008, 5 (01) :140-153
[7]   Anomaly detection of defects on concrete structures with the convolutional autoencoder [J].
Chow, J. K. ;
Su, Z. ;
Wu, J. ;
Tan, P. S. ;
Mao, X. ;
Wang, Y. H. .
ADVANCED ENGINEERING INFORMATICS, 2020, 45
[8]   Automated pipe defect detection and categorization using camera/laser-based profiler and artificial neural network [J].
Duran, O. ;
Althoefer, K. ;
Senevatne, L. D. .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2007, 4 (01) :118-126
[9]   A deep-learning-based approach for fast and robust steel surface defects classification [J].
Fu, Guizhong ;
Sun, Peize ;
Zhu, Wenbin ;
Yang, Jiangxin ;
Cao, Yanlong ;
Yang, Michael Ying ;
Cao, Yanpeng .
OPTICS AND LASERS IN ENGINEERING, 2019, 121 :397-405
[10]   A Multilevel Information Fusion-Based Deep Learning Method for Vision-Based Defect Recognition [J].
Gao, Yiping ;
Gao, Liang ;
Li, Xinyu ;
Wang, Xi Vincent .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (07) :3980-3991