A nondestructive automatic defect detection method with pixelwise segmentation

被引:86
作者
Yang, Lei [1 ,2 ]
Fan, Junfeng [3 ]
Huo, Benyan [1 ,2 ]
Li, En [3 ]
Liu, Yanhong [1 ,2 ]
机构
[1] Zhengzhou Univ, Sch Elect Engn, Zhengzhou 450001, Peoples R China
[2] Robot Percept & Control Engn Lab, Zhengzhou 450001, Henan, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Defect detection; Deep architecture; Image segmentation; Attention fusion; Residual dense connection convolution; network; NEURAL-NETWORK; RANDOM FOREST; SURFACE; INSPECTION; SYSTEM; MODEL; NET;
D O I
10.1016/j.knosys.2022.108338
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Defect detection is essential for the quality control and repair decision-making of various products. Due to collisions, uneven stress, welding parameters and other factors, cracks form on the surface or inside of products, which affect the product appearance and mechanism strength and may even cause huge safety accidents. Nondestructive testing (NDT) is an effective and practical method for accurate defect detection, but it still faces various challenges against complex factors, such as complex backgrounds, poor contrast, weak texture, and class imbalance issues. Recently, deep learning has rapidly improved the performance of automatic defect detection with the strong feature expression ability of deep convolutional neural networks (DCNNs). However, various limitations remain due to the insufficient processing of local contextual features, which affects the detection precision. To address this issue, with the encoder-decoder network structure, a novel nondestructive defect detection network, namely, NDD-Net, is proposed in this paper to construct an end-to-end nondestructive defect segmentation scheme. To make the segmentation network better emphasize the defect areas, an attention fusion block (AFB) is proposed to replace the raw skip connections to acquire more discriminative features and enhance the segmentation performance on microdefects. Meanwhile, by fusing a dense connection convolution network and a residual network, a residual dense connection convolution block (RDCCB) is also proposed to be embedded into the proposed segmentation network to acquire richer information about the local feature maps. Two public datasets with severe class imbalance issues are adopted for model evaluation: the Grima X-ray (GDXray) database and the rail surface discrete defects (RSSDs) dataset. Experimental results show that the proposed segmentation network outperforms other related segmentation models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 52 条
[1]   Weld Inspection Based on Radiography Image Segmentation with Level Set Active Contour Guided Off-Center Saliency Map [J].
Ben Gharsallah, Mohamed ;
Ben Braiek, Ezzeddine .
ADVANCES IN MATERIALS SCIENCE AND ENGINEERING, 2015, 2015
[2]   A Novel Compact Convolutional Neural Network for Real-Time Nondestructive Evaluation of Metallic Surfaces [J].
Borwankar, Raunak ;
Ludwig, Reinhold .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (10) :8466-8473
[3]   Rail inspection in track maintenance: A benchmark between the wavelet approach and the more conventional Fourier analysis [J].
Caprioli, A. ;
Cigada, A. ;
Raveglia, D. .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2007, 21 (02) :631-652
[4]   A robust weakly supervised learning of deep Conv-Nets for surface defect inspection [J].
Chen, Haiyong ;
Hu, Qidi ;
Zhai, Baoshuo ;
Chen, He ;
Liu, Kun .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (15) :11229-11244
[5]   SPGNet: Semantic Prediction Guidance for Scene Parsing [J].
Cheng, Bowen ;
Chen, Liang-Chieh ;
Wei, Yunchao ;
Zhu, Yukun ;
Huang, Zilong ;
Xiong, Jinjun ;
Huang, Thomas S. ;
Hwu, Wen-Mei ;
Shi, Honghui .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5217-5227
[6]   Online Rail Surface Inspection Utilizing Spatial Consistency and Continuity [J].
Gan, Jinrui ;
Wang, Jianzhu ;
Yu, Haomin ;
Li, Qingyong ;
Shi, Zhiping .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (07) :2741-2751
[7]   A Hierarchical Extractor-Based Visual Rail Surface Inspection System [J].
Gan, Jinrui ;
Li, Qingyong ;
Wang, Jianzhu ;
Yu, Haomin .
IEEE SENSORS JOURNAL, 2017, 17 (23) :7935-7944
[8]  
Gao R., IEEE T INSTRUM MEAS, V70, p1?11
[9]  
Gao Y., 2020, IEEE T IND INF
[10]   Insulator Segmentation for Power Line Inspection Based on Modified Conditional Generative Adversarial Network [J].
Gao, Zishu ;
Yang, Guodong ;
Li, En ;
Shen, Tianyu ;
Wang, Zhe ;
Tian, Yunong ;
Wang, Hao ;
Liang, Zize .
JOURNAL OF SENSORS, 2019, 2019