A deep-learning-based approach for fast and robust steel surface defects classification

被引:185
作者
Fu, Guizhong [1 ,2 ]
Sun, Peize [1 ,2 ]
Zhu, Wenbin [1 ,2 ]
Yang, Jiangxin [1 ,2 ]
Cao, Yanlong [1 ,2 ]
Yang, Michael Ying [3 ]
Cao, Yanpeng [1 ,2 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechtron Syst, Hangzhou, Zhejiang, Peoples R China
[2] Zhejiang Univ, Sch Mech Engn, Key Lab Adv Mfg Technol Zhejiang Prov, Hangzhou, Zhejiang, Peoples R China
[3] Univ Twente, Scene Understanding Grp, Hengelosestr 99, NL-7514 AE Enschede, Netherlands
基金
中国国家自然科学基金;
关键词
Surface inspection; Defect classification; Convolutional neural network; Feature extraction; Multi-receptive field; INSPECTION; FEATURES;
D O I
10.1016/j.optlaseng.2019.05.005
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Automatic visual recognition of steel surface defects provides critical functionality to facilitate quality control of steel strip production. In this paper, we present a compact yet effective convolutional neural network (CNN) model, which emphasizes the training of low-level features and incorporates multiple receptive fields, to achieve fast and accurate steel surface defect classification. Our proposed method adopts the pre-trained SqueezeNet as the backbone architecture. It only requires a small amount of defect-specific training samples to achieve high-accuracy recognition on a diversity-enhanced testing dataset of steel surface defects which contains severe nonuniform illumination, camera noise, and motion blur. Moreover, our proposed light-weight CNN model can meet the requirement of real-time online inspection, running over 100 fps on a computer equipped with a single NVIDIA TITAN X Graphics Processing Unit (12G memory). Codes and a diversity-enhanced testing dataset will be made publicly available.
引用
收藏
页码:397 / 405
页数:9
相关论文
共 40 条
[11]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[12]   Target Classification Using the Deep Convolutional Networks for SAR Images [J].
Chen, Sizhe ;
Wang, Haipeng ;
Xu, Feng ;
Jin, Ya-Qiu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (08) :4806-4817
[13]   Steel surface defects recognition based on multi-type statistical features and enhanced twin support vector machine [J].
Chu, Maoxiang ;
Gong, Rongfen ;
Gao, Song ;
Zhao, Jie .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 171 :140-150
[14]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[15]  
DONAHUE J, 2014, P INT C MACH LEARN, P647
[16]   CCD noise removal in digital images [J].
Faraji, Hilda ;
MacLean, W. James .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (09) :2676-2685
[17]   Automatic Defect Detection on Hot-Rolled Flat Steel Products [J].
Ghorai, Santanu ;
Mukherjee, Anirban ;
Gangadaran, M. ;
Dutta, Pranab K. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2013, 62 (03) :612-621
[18]  
Glorot X., 2010, P 13 INT C ART INT S, P249
[19]   TEXTURAL FEATURES FOR IMAGE CLASSIFICATION [J].
HARALICK, RM ;
SHANMUGAM, K ;
DINSTEIN, I .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1973, SMC3 (06) :610-621
[20]   Defect detection for corner cracks in steel billets using a wavelet reconstruction method [J].
Jeon, Yong-Ju ;
Choi, Doo-chul ;
Lee, Sang Jun ;
Yun, Jong Pil ;
Kim, Sang Woo .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2014, 31 (02) :227-237