Attention mechanism and texture contextual information for steel plate defects detection

被引:15
|
作者
Zhang, Chi [1 ]
Cui, Jian [1 ]
Wu, Jianguo [1 ]
Zhang, Xi [1 ]
机构
[1] Peking Univ, Dept Ind Engn & Management, Beijing, Peoples R China
关键词
Statistical texture feature fusion; Contextual information mining; Attention mechanism; Steel surface defect detection; CLASSIFICATION;
D O I
10.1007/s10845-023-02149-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve rapid inference and generalization results, the majority of Convolutional Neural Network (CNN) based semantic segmentation models strive to mine high-level features that contain rich contextual semantic information. However, at steel plate defects detection scenario, some background textures' noises are similar to the foreground leading to hard distinguishment, which will significantly interfere with feature extraction. Texture features themselves often hold the most plentiful contextual information. Despite this, semantic segmentation tasks rarely take texture features into account when identifying surface defects on steel plates. In that case, the essential details, such as the edge texture and other intuitive low-level features, will generally cannot be included into the final feature map. To address the problems of inefficient accuracy and slow speed of existing detection, this study proposed a steel plate surface defect detection method using contextual information and attention mechanism, and utilizes a multi-layer feature extraction method and fusion framework based on low-level statistical textures. Through the identification of pixel-level spatial and correlation relationships, characteristics of low-level defects are extracted. Furthermore, to effectively incorporate statistical texture in CNN, a novel quantization technique has been developed. This quantization method allows for the conversion of continuous texture into various levels of intensity. The network parameters were iterated in a gradient direction, facilitating the defects division. Empirical results have demonstrated the feasibility of applying the proposed approach to practical steel plate testing. Additionally, ablation experiments have demonstrated that the method is capable of effectively enhancing surface defect detection for steel plates, resulting in industry-leading performance.
引用
收藏
页码:2193 / 2214
页数:22
相关论文
共 50 条
  • [41] IMPROVED BUILDING DETECTION USING TEXTURE INFORMATION
    Awrangjeb, Mohammad
    Zhang, Chunsun
    Fraser, Clive S.
    PIA11: PHOTOGRAMMETRIC IMAGE ANALYSIS, 2011, 2011, 38-3 (W22): : 143 - 148
  • [42] Occluded Pedestrian Detection Based on Joint Attention Mechanism of Channel-wise and Spatial Information
    Chen Yong
    Liu Xi
    Liu Huanlin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (06) : 1486 - 1493
  • [43] Attention guided contextual feature fusion network for salient object detection
    Zhang, Jin
    Shi, Yanjiao
    Zhang, Qing
    Cui, Liu
    Chen, Ying
    Yi, Yugen
    IMAGE AND VISION COMPUTING, 2022, 117
  • [44] MSACon: Mining Spatial Attention-Based Contextual Information for Road Extraction
    Xu, Yingxiao
    Chen, Hao
    Du, Chun
    Li, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [45] A strip steel surface defect detection method based on attention mechanism and multi-scale maxpooling
    Tang, Ming
    Li, Yuanyuan
    Yao, Wei
    Hou, Lingyu
    Sun, Qichun
    Chen, Jiahang
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (11)
  • [46] Small target detection algorithm based on attention mechanism and data augmentation
    Wang, Jiuxin
    Liu, Man
    Su, Yaoheng
    Yao, Jiahui
    Du, Yurong
    Zhao, Minghu
    Lu, Dingze
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (04) : 3837 - 3853
  • [47] Semi-supervised learning and attention mechanism for weed detection in wheat
    Liu, Teng
    Jin, Xiaojun
    Zhang, Luyao
    Wang, Jie
    Chen, Yong
    Hu, Chengsong
    Yu, Jialin
    CROP PROTECTION, 2023, 174
  • [48] The use of contextual information for computer aided detection of masses in mammograms
    Hupse, Rianne
    Karssemeijer, Nico
    MEDICAL IMAGING 2009: COMPUTER-AIDED DIAGNOSIS, 2009, 7260
  • [49] Composite Backbone Small Object Detection Based on Context and Multi-Scale Information with Attention Mechanism
    Jing, Xinhan
    Liu, Xuesong
    Liu, Baolin
    MATHEMATICS, 2024, 12 (05)
  • [50] Maritime object detection using attention mechanism
    Messaoud, Walid
    Trabelsi, Rim
    Cabani, Adnane
    Abdelkefi, Fatma
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (02) : 1833 - 1845