Novel industrial surface-defect detection using deep nested convolutional network with attention and guidance modules

被引:12
作者
Park, Kyeong-Beom [1 ]
Lee, Jae Yeol [1 ]
机构
[1] Chonnam Natl Univ, Dept Ind Engn, 77 Yongbong Ro, Gwangju 61186, South Korea
基金
新加坡国家研究基金会;
关键词
edge and mask guidance; surface-defect detection; nested encoder-decoder network; residual u-block; NEURAL-NETWORK; VISION SYSTEM; SEGMENTATION; INSPECTION;
D O I
10.1093/jcde/qwac115
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Industrial defect inspection plays a crucial role in maintaining the high quality of the product. Although deep learning technologies have been applied to conduct automatic defect inspection, it is still difficult to detect industrial surface defects accurately due to complex variations. This study proposes a novel approach to industrial surface-defect detection that segments defect areas accurately and robustly from the complex background using a deep nested convolutional network (NC-Net) with attention and guidance modules. NC-Net consists of the encoder-decoder with nested residual U-blocks and feature enhancement modules. Each layer block of the encoder and decoder is also represented as a residual U-block. In addition, features are adaptively refined by applying the attention module to the skip connection between the encoder and decoder. Low-level encoder features are refined through edge guidance, and high-level encoder features through mask guidance, which can keep local and global contexts for accurate and robust defect detection. A comprehensive evaluation was conducted to verify the novelty and robustness of NC-Net using four datasets, including magnetic tile surface defects, steel surface defects, rail surface defects, and road surface defects. The proposed method outperformed previous state-of-the-art studies. An additional dataset was also evaluated to prove the extensibility and generality of the proposed approach.
引用
收藏
页码:2466 / 2482
页数:17
相关论文
共 58 条
  • [1] The Phase Only Transform for unsupervised surface defect detection
    Aiger, Dror
    Talbot, Hugues
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 295 - 302
  • [2] Machine learning for predicting long-term deflections in reinforce concrete flexural structures
    Anh-Duc Pham
    Ngoc-Tri Ngo
    Thi-Kha Nguyen
    [J]. JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2020, 7 (01) : 95 - 106
  • [3] [Anonymous], 2012, International Journal of Software Engineering and Its Applications
  • [4] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [5] Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum
    Bai, Xiaolong
    Fang, Yuming
    Lin, Weisi
    Wang, Lipo
    Ju, Bing-Feng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (04) : 2135 - 2145
  • [6] MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
    Bergmann, Paul
    Fauser, Michael
    Sattlegger, David
    Steger, Carsten
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9584 - 9592
  • [7] Mixed supervision for surface-defect detection: From weakly to fully supervised learning
    Bozic, Jakob
    Tabernik, Domen
    Skocaj, Danijel
    [J]. COMPUTERS IN INDUSTRY, 2021, 129
  • [8] Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks
    Cha, Young-Jin
    Choi, Wooram
    Buyukozturk, Oral
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) : 361 - 378
  • [9] Reverse Attention for Salient Object Detection
    Chen, Shuhan
    Tan, Xiuli
    Wang, Ben
    Hu, Xuelong
    [J]. COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 236 - 252
  • [10] An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation
    Choi, Sung Ho
    Park, Kyeong-Beom
    Roh, Dong Hyeon
    Lee, Jae Yeol
    Mohammed, Mustafa
    Ghasemi, Yalda
    Jeong, Heejin
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 73