Bilateral guidance network for one-shot metal defect segmentation

被引:1
|
作者
Shan, Dexing [1 ]
Zhang, Yunzhou [1 ]
Liu, Xiaozheng [1 ]
Zhao, Jiaqi [1 ]
Coleman, Sonya [2 ]
Kerr, Dermot [2 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Liaoning, Peoples R China
[2] Univ Ulster, Intelligent Syst Res Ctr, Londonderry, England
关键词
Neural network application; One-shot metal defect segmentation; Affinity learning; Bilateral guidance mechanism; Cross-attention;
D O I
10.1016/j.engappai.2023.107802
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Metal defect inspection is critical for maintaining product quality and ensuring production safety. However, the vast majority of existing defect segmentation methods rely heavily on large-scale datasets that only cater to specific defects, making them unsuitable for the industrial sector, where training samples are often limited. To address these challenges, we propose a bilateral guidance network for one-shot metal defect segmentation that leverages the perceptual consistency of background regions within industrial images to distinguish foreground and background regions. Our model uses an interactive feature reweighting scheme that models the inter- and self -dependence of foreground and background feature maps, enabling us to build robust pixel -level correspondences. Our proposed method demonstrates good domain adaptability and accurately segments defects in multiple materials, such as steel, leather, and carpet, among others. Additionally, we have incorporated a multi -scale receptive field encoder to enhance the model's ability to perceive objects of varying scales, providing a comprehensive solution for industrial defect segmentation. Experimental results indicate that our proposed method has the potential to be effective in a variety of real -world applications where defects may not be immediately visible or where large amounts of labeled data are not readily available. With only one shot, our method achieves the state-of-the-art performance of 41.62% mIoU and 70.30% MPA on the Defect-3' dataset.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] SG-One: Similarity Guidance Network for One-Shot Semantic Segmentation
    Zhang, Xiaolin
    Wei, Yunchao
    Yang, Yi
    Huang, Thomas S.
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (09) : 3855 - 3865
  • [2] One-Shot Segmentation in Clutter
    Michaelis, Claudio
    Bethge, Matthias
    Ecker, Alexander S.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [3] Contour Transformer Network for One-Shot Segmentation of Anatomical Structures
    Lu, Yuhang
    Zheng, Kang
    Li, Weijian
    Wang, Yirui
    Harrison, Adam P.
    Lin, Chihung
    Wang, Song
    Xiao, Jing
    Lu, Le
    Kuo, Chang-Fu
    Miao, Shun
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (10) : 2672 - 2684
  • [4] Weakly Supervised One-Shot Segmentation
    Raza, Hasnain
    Ravanbakhsh, Mahdyar
    Klein, Tassilo
    Nabi, Moin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1401 - 1406
  • [5] One-Shot Video Object Segmentation
    Caelles, S.
    Maninis, K. -K.
    Pont-Tuset, J.
    Leal-Taixe, L.
    Cremers, D.
    Van Gool, L.
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5320 - 5329
  • [6] Self-supervised assisted multi-task learning network for one-shot defect segmentation with fake defect generation
    Hu, Ziqiang
    Chu, Hao
    Zhang, Yunzhou
    Shan, Dexing
    Shen, You
    PATTERN RECOGNITION LETTERS, 2024, 184 : 89 - 96
  • [7] One-Shot Uncertainty Estimation for Deep Network Based Image Segmentation
    Min, Y.
    Ruan, D.
    MEDICAL PHYSICS, 2020, 47 (06) : E433 - E433
  • [8] One-Shot Synthesis of Images and Segmentation Masks
    Sushko, Vadim
    Zhang, Dan
    Gall, Juergen
    Khoreva, Anna
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 6274 - 6283
  • [9] One Sketch for All: One-Shot Personalized Sketch Segmentation
    Qi, Anran
    Gryaditskaya, Yulia
    Xiang, Tao
    Song, Yi-Zhe
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2673 - 2682
  • [10] Shape-Consistent One-Shot Unsupervised Domain Adaptation for Rail Surface Defect Segmentation
    Ma, Shuai
    Song, Kechen
    Niu, Menghui
    Tian, Hongkun
    Wang, Yanyan
    Yan, Yunhui
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (09) : 9667 - 9679