Bilateral guidance network for one-shot metal defect segmentation

被引:5
作者
Shan, Dexing [1 ]
Zhang, Yunzhou [1 ]
Liu, Xiaozheng [1 ]
Zhao, Jiaqi [1 ]
Coleman, Sonya [2 ]
Kerr, Dermot [2 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Liaoning, Peoples R China
[2] Univ Ulster, Intelligent Syst Res Ctr, Londonderry, England
关键词
Neural network application; One-shot metal defect segmentation; Affinity learning; Bilateral guidance mechanism; Cross-attention;
D O I
10.1016/j.engappai.2023.107802
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Metal defect inspection is critical for maintaining product quality and ensuring production safety. However, the vast majority of existing defect segmentation methods rely heavily on large-scale datasets that only cater to specific defects, making them unsuitable for the industrial sector, where training samples are often limited. To address these challenges, we propose a bilateral guidance network for one-shot metal defect segmentation that leverages the perceptual consistency of background regions within industrial images to distinguish foreground and background regions. Our model uses an interactive feature reweighting scheme that models the inter- and self -dependence of foreground and background feature maps, enabling us to build robust pixel -level correspondences. Our proposed method demonstrates good domain adaptability and accurately segments defects in multiple materials, such as steel, leather, and carpet, among others. Additionally, we have incorporated a multi -scale receptive field encoder to enhance the model's ability to perceive objects of varying scales, providing a comprehensive solution for industrial defect segmentation. Experimental results indicate that our proposed method has the potential to be effective in a variety of real -world applications where defects may not be immediately visible or where large amounts of labeled data are not readily available. With only one shot, our method achieves the state-of-the-art performance of 41.62% mIoU and 70.30% MPA on the Defect-3' dataset.
引用
收藏
页数:11
相关论文
共 41 条
[31]   Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking [J].
Wang, Ning ;
Zhou, Wengang ;
Wang, Jie ;
Li, Houqiang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :1571-1580
[32]   Deep Learning-Based Generic Automatic Surface Defect Inspection (ASDI) With Pixelwise Segmentation [J].
Wu, Xiaojun ;
Qiu, LingTeng ;
Gu, Xiaodong ;
Long, Zhili .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[33]   Complementary features based prototype self-updating for few-shot learning [J].
Xu, Xinlei ;
Wang, Zhe ;
Chi, Ziqiu ;
Yang, Hai ;
Du, Wenli .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 214
[34]   Prototype Mixture Models for Few-Shot Semantic Segmentation [J].
Yang, Boyu ;
Liu, Chang ;
Li, Bohao ;
Jiao, Jianbin ;
Ye, Qixiang .
COMPUTER VISION - ECCV 2020, PT VIII, 2020, 12353 :763-778
[35]   A pixel-level deep segmentation network for automatic defect detection [J].
Yang, Lei ;
Xu, Shuai ;
Fan, Junfeng ;
Li, En ;
Liu, Yanhong .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 215
[36]   A nondestructive automatic defect detection method with pixelwise segmentation [J].
Yang, Lei ;
Fan, Junfeng ;
Huo, Benyan ;
Li, En ;
Liu, Yanhong .
KNOWLEDGE-BASED SYSTEMS, 2022, 242
[37]   Selective Prototype Network for Few-Shot Metal Surface Defect Segmentation [J].
Yu, Ruiyun ;
Guo, Bingyang ;
Yang, Kang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[38]   CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learning [J].
Zhang, Chi ;
Lin, Guosheng ;
Liu, Fayao ;
Yao, Rui ;
Shen, Chunhua .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5212-5221
[39]   MCnet: Multiple Context Information Segmentation Network of No-Service Rail Surface Defects [J].
Zhang, Defu ;
Song, Kechen ;
Xu, Jing ;
He, Yu ;
Niu, Menghui ;
Yan, Yunhui .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[40]   SG-One: Similarity Guidance Network for One-Shot Semantic Segmentation [J].
Zhang, Xiaolin ;
Wei, Yunchao ;
Yang, Yi ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (09) :3855-3865