Enhanced Multiview attention network with random interpolation resize for few-shot surface defect detection

被引:11
作者
Li, Penghao [1 ]
Tao, Huanjie [1 ,2 ,3 ]
Zhou, Hui [1 ]
Zhou, Ping [1 ]
Deng, Yishi [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China
[2] Northwestern Polytech Univ, Engn & Res Ctr Embedded Syst Integrat, Minist Educ, Xian 710129, Peoples R China
[3] Natl Engn Lab Integrated Aerospace Ground Ocean Bi, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Few-shot; Defect detection; Attention mechanism; Data augmentation;
D O I
10.1007/s00530-024-01643-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot surface defect detection aims to detect or identify potential defects with limited data and has significant application value in improving the quality of industrial products. Challenges in few-shot surface defect detection include sparse samples and the diversity of defects. Existing methods typically employ transfer learning and meta-learning techniques, utilizing a single interpolation method for image resizing and single-view method for feature extraction. However, single-view feature extraction may lead to discriminative defect features being drowned out, and using a single interpolation method hinders the model's generalization capacity. To address these issues, we propose the ERNet (Enhanced Multiview Attention Model with Random Interpolation Resize). Firstly, we employ the Multiview Attention Module (MAM) by utilizing three parallel channel attention mechanisms to learn more discriminative defect features and enhance the diversity of the extracted defect characteristics. Secondly, we employ the Random Interpolation Resize (RIR) data augmentation method to enhance the diversity of training data and improve the model's generalization. Experimental results on the GC10-DET, NEU-DET, and TCAL datasets demonstrate that our method achieves outstanding performance across different experimental settings. The code is available at: https://github.com/lph656/ERNet.
引用
收藏
页数:15
相关论文
共 60 条
[1]   A Robust Asymmetric Kernel Function for Bayesian Optimization, With Application to Image Defect Detection in Manufacturing Systems [J].
AlBahar, Areej ;
Kim, Inyoung ;
Yue, Xiaowei .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (04) :3222-3233
[2]   Toward Universal Stripe Removal via Wavelet-Based Deep Convolutional Neural Network [J].
Chang, Yi ;
Chen, Meiya ;
Yan, Luxin ;
Zhao, Xi-Le ;
Li, Yi ;
Zhong, Sheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (04) :2880-2897
[3]   Few-shot imbalanced classification based on data augmentation [J].
Chao, Xuewei ;
Zhang, Lixin .
MULTIMEDIA SYSTEMS, 2023, 29 (05) :2843-2851
[4]   You Only Look One-level Feature [J].
Chen, Qiang ;
Wang, Yingming ;
Yang, Tong ;
Zhang, Xiangyu ;
Cheng, Jian ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13034-13043
[5]   DID: Disentangling-Imprinting-Distilling for Continuous Low-Shot Detection [J].
Chen, Xianyu ;
Wang, Yali ;
Liu, Jianzhuang ;
Qiao, Yu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) :7765-7778
[6]  
Cheng X., 2020, J IEEE Trans. Instrum. Meas., V70, P11, DOI [10.1109/TIM.2020.30404851444.76023, DOI 10.1109/TIM.2020.30404851444.76023]
[7]   TDD-net: a tiny defect detection network for printed circuit boards [J].
Ding, Runwei ;
Dai, Linhui ;
Li, Guangpeng ;
Liu, Hong .
CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2019, 4 (02) :110-116
[8]   An Improved YOLOv5s Fire Detection Model [J].
Dou, Zhan ;
Zhou, Hang ;
Liu, Zhe ;
Hu, Yuanhao ;
Wang, Pengchao ;
Zhang, Jianwen ;
Wang, Qianlin ;
Chen, Liangchao ;
Diao, Xu ;
Li, Jinghai .
FIRE TECHNOLOGY, 2024, 60 (01) :135-166
[9]   Generalized Few-Shot Object Detection without Forgetting [J].
Fan, Zhibo ;
Ma, Yuchen ;
Li, Zeming ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4525-4534
[10]   NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging [J].
Guirguis, Karim ;
Meier, Johannes ;
Eskandar, George ;
Kayser, Matthias ;
Yang, Bin ;
Beyerer, Juergen .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :24193-24202