Bilateral guidance network for one-shot metal defect segmentation

被引:1
|
作者
Shan, Dexing [1 ]
Zhang, Yunzhou [1 ]
Liu, Xiaozheng [1 ]
Zhao, Jiaqi [1 ]
Coleman, Sonya [2 ]
Kerr, Dermot [2 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Liaoning, Peoples R China
[2] Univ Ulster, Intelligent Syst Res Ctr, Londonderry, England
关键词
Neural network application; One-shot metal defect segmentation; Affinity learning; Bilateral guidance mechanism; Cross-attention;
D O I
10.1016/j.engappai.2023.107802
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Metal defect inspection is critical for maintaining product quality and ensuring production safety. However, the vast majority of existing defect segmentation methods rely heavily on large-scale datasets that only cater to specific defects, making them unsuitable for the industrial sector, where training samples are often limited. To address these challenges, we propose a bilateral guidance network for one-shot metal defect segmentation that leverages the perceptual consistency of background regions within industrial images to distinguish foreground and background regions. Our model uses an interactive feature reweighting scheme that models the inter- and self -dependence of foreground and background feature maps, enabling us to build robust pixel -level correspondences. Our proposed method demonstrates good domain adaptability and accurately segments defects in multiple materials, such as steel, leather, and carpet, among others. Additionally, we have incorporated a multi -scale receptive field encoder to enhance the model's ability to perceive objects of varying scales, providing a comprehensive solution for industrial defect segmentation. Experimental results indicate that our proposed method has the potential to be effective in a variety of real -world applications where defects may not be immediately visible or where large amounts of labeled data are not readily available. With only one shot, our method achieves the state-of-the-art performance of 41.62% mIoU and 70.30% MPA on the Defect-3' dataset.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Hierarchical context-agnostic network with contrastive feature diversity for one-shot semantic segmentation
    Fang, Zhiyuan
    Gao, Guangyu
    Zhang, Zekang
    Zhang, Anqi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [22] One-shot integral invariant shape priors for variational segmentation
    Manay, S
    Cremers, D
    Yezzi, A
    Soatto, S
    ENERGY MINIMIZATION METHODS IN COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 2005, 3757 : 414 - 426
  • [23] One-shot Joint Extraction, Registration and Segmentation of Neuroimaging Data
    Su, Yao
    Qian, Zhentian
    Ma, Lei
    He, Lifang
    Kong, Xiangnan
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2049 - 2060
  • [24] A Spatiotemporal Mask Autoencoder for One-shot Video Object Segmentation
    Chen, Baiyu
    Zhao, Li
    Chan, Sixian
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON FRONTIERS OF ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING, FAIML 2024, 2024, : 6 - 12
  • [25] One-Shot Learning-Based Animal Video Segmentation
    Xue, Tengfei
    Qiao, Yongliang
    Kong, He
    Su, Daobilige
    Pan, Shirui
    Rafique, Khalid
    Sukkarieh, Salah
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (06) : 3799 - 3807
  • [26] One-Shot Video Object Segmentation Using Attention Transfer
    Chanda, Omit
    Wang, Yang
    2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [27] One-shot learning based on improved matching network
    Jiang L.
    Zhou X.
    Jiang F.
    Che L.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2019, 41 (06): : 1210 - 1217
  • [28] Deformable One-shot Face Stylization via DINO Semantic Guidance
    Zhou, Yang
    Chen, Zichong
    Huang, Hui
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 7787 - 7796
  • [29] ONE NAND ONE-SHOT
    LESERVE, B
    ELECTRONIC ENGINEER, 1971, 30 (03): : 54 - &
  • [30] Triplet Network for One-Shot Raman Spectrum Recognition
    Wang, Bo
    Zhang, Pu
    Zhao, Wei
    Ren, Wenzhen
    Zhu, Xiangping
    Jiao, Ying
    Liao, Qi
    Yao, Zhen
    APPLIED SPECTROSCOPY, 2024,