Automatic Defect Segmentation in X-Ray Images Based on Deep Learning

被引:48
作者
Du, Wangzhe [1 ,2 ]
Shen, Hongyao [1 ,2 ]
Fu, Jianzhong [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Coll Mech Engn, Key Lab 3D Printing Proc & Equipment Zhejiang Pr, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Image segmentation; X-ray imaging; Feature extraction; Semantics; Deep learning; Object segmentation; Manufacturing; Casting parts; computer vision; deep learning; defect segmentation; nondestructive testing (NDT); X-ray image; CASTINGS;
D O I
10.1109/TIE.2020.3047060
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
X-ray imaging has been broadly adopted as a nondestructive testing method for product quality inspection. Deep learning has demonstrated powerful image scene understanding capabilities. In this article, U-Net with resnet101 is taken as the baseline for defect segmentation. First, there exist gray inhomogeneous and low-contrast regions in X-ray images, which can hardly be segmented. Contrast-limited adaptive histogram equalization (CLAHE) could be used to improve the contrast and consistency of the X-ray image. A two-stream convolutional neural network (CNN) is proposed that takes the original image and CLAHE processed image as inputs to address this issue. And then in CNN, low-level feature maps are lacking semantic information, which may lead to worse results. A gated multilayer fusion module is proposed to adaptively fuse the high-level features into low-level features. Furthermore, loss functions (such as cross entropy) in semantic segmentation are usually pixel level, ignoring the regional information. A weighted intersection over union (IOU) loss function is proposed to introduce IOU information to guide the model to focus on the objects that are easy to mine. The experimental results prove that the three proposed methods have better performance than the baseline for our dataset, achieving 42.2 in mIoU, 59.2 in Dice, and 54.5%, 74.9%, and 86.3% in small, middle, and large object recall rate, respectively.
引用
收藏
页码:12912 / 12920
页数:9
相关论文
共 30 条
[1]  
[Anonymous], 2017, Computing Research Repository
[2]  
[Anonymous], 2018, P EUROPEAN C COMPUTE
[3]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[4]   Automatic ultrasonic inspection for internal defect detection in composite materials [J].
D'Orazio, T. ;
Leo, M. ;
Distante, A. ;
Guaragnella, C. ;
Pianese, V. ;
Cavaccini, G. .
NDT & E INTERNATIONAL, 2008, 41 (02) :145-154
[5]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[6]   Automated detection of defects with low semantic information in X-ray images based on deep learning [J].
Du, Wangzhe ;
Shen, Hongyao ;
Fu, Jianzhong ;
Zhang, Ge ;
Shi, Xuanke ;
He, Quan .
JOURNAL OF INTELLIGENT MANUFACTURING, 2021, 32 (01) :141-156
[7]   Approaches for improvement of the X-ray image defect detection of automobile casting aluminum parts based on deep learning [J].
Du, Wangzhe ;
Shen, Hongyao ;
Fu, Jianzhong ;
Zhang, Ge ;
He, Quan .
NDT & E INTERNATIONAL, 2019, 107
[8]   Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning [J].
Ferguson, Max ;
Ak, Ronay ;
Lee, Yung-Tsun Tina ;
Law, Kincho H. .
SMART AND SUSTAINABLE MANUFACTURING SYSTEMS, 2018, 2 (01) :137-164
[9]   Advanced 3D failure characterization in multi-layered PCBs [J].
Gruenwald, E. ;
Hammer, R. ;
Rosc, J. ;
Maier, G. A. ;
Baernthaler, M. ;
Cordill, M. J. ;
Brand, S. ;
Nuster, R. ;
Krivec, T. ;
Brunner, R. .
NDT & E INTERNATIONAL, 2016, 84 :99-107
[10]   Fusion of multispectral data through illumination-aware deep neural networks for pedestrian detection [J].
Guan, Dayan ;
Cao, Yanpeng ;
Yang, Jiangxin ;
Cao, Yanlong ;
Yang, Michael Ying .
INFORMATION FUSION, 2019, 50 :148-157