EDSV-Net: An efficient defect segmentation network based on visual attention and visual perception

被引:1
作者
Huang, Yanqing [1 ]
Jing, Junfeng [1 ]
Sheng, Siyu [1 ]
Wang, Zhen [1 ]
机构
[1] Xian Polytech Univ, Coll Elect & Informat, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Surface defect detection; Defect segmentation; Convolutional neural network; Visual attention; Multi-scale; Structural similarity measure; INSPECTION; IMAGES; FEATURES;
D O I
10.1016/j.eswa.2023.121529
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In industrial production, surface defect detection algorithms based on convolutional neural networks have been widely studied to improve production quality. However, for practical applications, there are still many issues to be solved, such as the complexity and diversity of defect categories, the difficulty of obtaining defect samples, and the difficulty of existing algorithms in accurately segmenting defects. To solve these issues, we present an effective defect segmentation network based on visual attention and visual perception termed EDSV-Net. Specifically, we use ResNet18 as the backbone network in EDSV-Net. Then a multi-scale feature extraction (MSFE) module is introduced to enhance the scale invariance of high-level features and the diversity of contextual features. In addition, a spatial attention (SA) model combined with a channel attention (CA) model is applied to low level features and MSFE features, respectively, to extract more effective spatial and semantic information. Moreover, a depthwise separable convolution is introduced to reduce the network complexity. Finally, due to the issues of existing defect detection algorithms ignoring structural similarity and defects being difficult to obtain, we design a balanced defect and structural measure loss function. Meanwhile, we propose a structural similarity measure, which combines the pixel similarity for evaluation. EDSV-Net only requires no more than 60 random abnormal samples to obtain accurate segmentation results and the real-time performance meets the requirements of actual industrial production. Based on three challenging real-world defect datasets, the results of the evaluation demonstrate that EDSV-Net outperforms seven state-of-the-art methods on accuracy and real-time performance.
引用
收藏
页数:15
相关论文
共 73 条
  • [1] Anitha S., 2013, P 4 INT C SIGN IM PR, P433
  • [2] Contour Detection and Hierarchical Image Segmentation
    Arbelaez, Pablo
    Maire, Michael
    Fowlkes, Charless
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) : 898 - 916
  • [3] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [4] Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum
    Bai, Xiaolong
    Fang, Yuming
    Lin, Weisi
    Wang, Lipo
    Ju, Bing-Feng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (04) : 2135 - 2145
  • [5] Development of a real-time home textile fabric defect inspection machine system for the textile industry
    Barman, Jagadish
    Wu, Han-Cheng
    Kuo, Chung-Feng Jeffrey
    [J]. TEXTILE RESEARCH JOURNAL, 2022, 92 (23-24) : 4778 - 4788
  • [6] MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
    Bergmann, Paul
    Fauser, Michael
    Sattlegger, David
    Steger, Carsten
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9584 - 9592
  • [7] Salient object detection: A survey
    Borji, Ali
    Cheng, Ming-Ming
    Hou, Qibin
    Jiang, Huaizu
    Li, Jia
    [J]. COMPUTATIONAL VISUAL MEDIA, 2019, 5 (02) : 117 - 150
  • [8] Borji A, 2012, PROC CVPR IEEE, P478, DOI 10.1109/CVPR.2012.6247711
  • [9] An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform
    Borwankar, Raunak
    Ludwig, Reinhold
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (03) : 690 - 697
  • [10] Fabric defect detection based on multiple fractal features and support vector data description
    Bu, Hong-gang
    Wang, Jun
    Huang, Xiu-bao
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2009, 22 (02) : 224 - 235