Intelligent Detection and Classification of Surface Defects on Cold-Rolled Galvanized Steel Strips Using a Data-Driven Faulty Model With Attention Mechanism

被引:7
作者
Chen, Hao [1 ,2 ]
Nie, Zhenguo [3 ,4 ]
Xu, Qingfeng [3 ,4 ]
Fei, Jianghua [2 ]
Yang, Kang [2 ]
Li, Yaguan [3 ,4 ,5 ]
Lin, Hongbin [6 ]
Fan, Wenhui [1 ]
Liu, Xin-Jun [3 ,4 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Shanghai Baosight Software Co Ltd, Shanghai 201203, Peoples R China
[3] Tsinghua Univ, Dept Mech Engn, State Key Lab Tribol, Beijing 100084, Peoples R China
[4] Tsinghua Univ, Beijing Key Lab Precis Ultraprecis Mfg Equipments, Beijing 100084, Peoples R China
[5] Taiyuan Univ Technol, Coll Mech & Vehicle Engn, Taiyuan 030024, Shanxi, Peoples R China
[6] Guangzhou Univ, Sch Math & Informat Sci, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
artificial intelligence; big data and analytics; engineering informatics; manufacturing automation;
D O I
10.1115/1.4055672
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In the production of cold-rolled galvanized steel strips used for stamping car body parts, the in-situ and real-time defect detection is crucial for quality control, in which various types of defects inevitably occur. It is challenging to improve the accuracy of defect detection and classification by appropriate means to assist the manual screening process better. Defects under actual production conditions are often not prominent enough in defect characteristics, and there may be a significant similarity between different defect categories. To eliminate this weakness, we propose a data-driven deep learning approach named steel surface faulty detection attention net (SSFDANet) that uses images of the galvanized steel surfaces as input to identify whether the product is qualified and automatic classification of defect types instantaneously. This method can shorten product inspection time and improve the production line automation efficiency. In addition, the attention mechanism is utilized to enhance the performance of SSFDANet. Compared with the baseline ResNet, SSFDANet achieves a noticeable improvement in classification accuracy on test data. The well-trained model can successfully show an improved performance than the baseline models on the multiple types of faulty. Enhanced by SSFDANet with high classification accuracy, the defect rate of products is significantly reduced, and the production speed of the production line is significantly improved. Future prospective studies that are inspired by this article are also discussed.
引用
收藏
页数:8
相关论文
共 38 条
[1]   Medical image segmentation algorithm based on multilayer boundary perception-self attention deep learning model [J].
An, Feng-Ping ;
Liu, Jun-e .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (10) :15017-15039
[2]   MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9584-9592
[3]   Image-Based Surface Defect Detection Using Deep Learning: A Review [J].
Bhatt, Prahar M. ;
Malhan, Rishi K. ;
Rajendran, Pradeep ;
Shah, Brual C. ;
Thakar, Shantanu ;
Yoon, Yeo Jung ;
Gupta, Satyandra K. .
JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING, 2021, 21 (04)
[5]  
Cao C., 2015, LOOK THINK TWICE CAP
[6]   An Integrative Machine Learning Method to Improve Fault Detection and Productivity Performance in a Cyber-Physical System [J].
Chiu, Ming-Chuan ;
Tsai, Chien-De ;
Li, Tung-Lung .
JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING, 2020, 20 (02)
[7]   A Deep Convolutional Neural Network with Selection Units for Super-Resolution [J].
Choi, Jae-Seok ;
Kim, Munchurl .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1150-1156
[8]   TextSpamDetector: textual content based deep learning framework for social spam detection using conjoint attention mechanism [J].
Elakkiya, E. ;
Selvakumar, S. ;
Leela Velusamy, R. .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (10) :9287-9302
[9]  
Girshick Ross B., 2015, CoRR
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778