Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks

被引:345
作者
Tao, Xian [1 ]
Zhang, Dapeng [1 ]
Ma, Wenzhi [2 ]
Liu, Xilong [1 ]
Xu, De [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, Res Ctr Precis Sensing & Control, Beijing 100190, Peoples R China
[2] China Univ Min & Technol, Sch Mech Elect & Informat Engn, Beijing 100083, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2018年 / 8卷 / 09期
基金
中国国家自然科学基金;
关键词
metallic surface; autoencoder; convolutional neural network; defect detection; FAULT-DIAGNOSIS; CLASSIFICATION; INSPECTION; IMAGES; MODEL;
D O I
10.3390/app8091575
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Automatic metallic surface defect inspection has received increased attention in relation to the quality control of industrial products. Metallic defect detection is usually performed against complex industrial scenarios, presenting an interesting but challenging problem. Traditional methods are based on image processing or shallow machine learning techniques, but these can only detect defects under specific detection conditions, such as obvious defect contours with strong contrast and low noise, at certain scales, or under specific illumination conditions. This paper discusses the automatic detection of metallic defects with a twofold procedure that accurately localizes and classifies defects appearing in input images captured from real industrial environments. A novel cascaded autoencoder (CASAE) architecture is designed for segmenting and localizing defects. The cascading network transforms the input defect image into a pixel-wise prediction mask based on semantic segmentation. The defect regions of segmented results are classified into their specific classes via a compact convolutional neural network (CNN). Metallic defects under various conditions can be successfully detected using an industrial dataset. The experimental results demonstrate that this method meets the robustness and accuracy requirements for metallic defect detection. Meanwhile, it can also be extended to other detection applications.
引用
收藏
页数:15
相关论文
共 46 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
Adam H., Rethinking Atrous Convolution for Semantic Image Segmentation
[3]  
[Anonymous], 2011, P INT C MULT TECHN H
[4]  
[Anonymous], 2016, Lecture Notes in Computer Science, DOI [10.1007/978-3-319-46493-0_38, DOI 10.1007/978-3-319-46493-0_38]
[5]  
[Anonymous], 2017, P IEEE INT C IND TEC
[6]   Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum [J].
Bai, Xiaolong ;
Fang, Yuming ;
Lin, Weisi ;
Wang, Lipo ;
Ju, Bing-Feng .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (04) :2135-2145
[7]   An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform [J].
Borwankar, Raunak ;
Ludwig, Reinhold .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (03) :690-697
[8]   Defect Detection in SEM Images of Nanofibrous Materials [J].
Carrera, Diego ;
Manganini, Fabio ;
Boracchi, Giacomo ;
Lanzarone, Ettore .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2017, 13 (02) :551-561
[9]   Defect inspection for TFT-LCD images based on the low-rank matrix reconstruction [J].
Cen, Yi-Gang ;
Zhao, Rui-Zhen ;
Cen, Li-Hui ;
Cui, Li-Hong ;
Miao, Zhen-Jiang ;
Wei, Zhe .
NEUROCOMPUTING, 2015, 149 :1206-1215
[10]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747