Coupling of unsupervised and supervised deep learning-based approaches for surface anomaly detection

被引:0
作者
Racki, Domen [1 ,2 ]
Tomazevic, Dejan [1 ,3 ]
Skocaj, Danijel [2 ]
机构
[1] Sensum Comp Vis Syst, Ljubljana, Slovenia
[2] Univ Ljubljana, Fac Comp & Informat Sci, Ljubljana, Slovenia
[3] Univ Ljubljana, Fac Elect Engn, Ljubljana, Slovenia
关键词
surface defect detection; segmentation; visual inspection; quality control; solid oral dosage forms; pharmaceutical industry; deep learning; convolutional neural networks;
D O I
10.1117/1.JEI.33.3.031207
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. Anomaly detection (AD) in an unsupervised manner has become the go-to approach in applications where data labeling proves problematic. However, these approaches are not completely unsupervised, since they rely on the weak knowledge of the dataset distribution into anomalous and anomaly-free subsets and typically require post-training threshold calibration in order to perform AD. Yet, they do not take advantage of available positive samples during training. In contrast, fully supervised approaches have proven to be more accurate and more efficient; however, they require a sufficient number of anomalous images to be labeled on a per-pixel level, which represents a labor-intensive task. In this article, we propose a hybrid approach that utilizes the best of both worlds. We use an unsupervised approach to build a model for generating pseudo labels, followed by a supervised approach to increase the robustness of AD. Moreover, we extend this approach with an active learning schema that results in learning with mixed supervision. We achieve several improvements, i.e., the utilization of available positive image samples, improved AD performance, and the retention of real-time performance. The proposed approach yields results that are comparable to the fully supervised approach, and at the very least, reduces the number of required labeled anomalous samples.
引用
收藏
页数:16
相关论文
共 67 条
[1]  
Akay S., 2018, ACCV
[2]   Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection [J].
Akcay, Samet ;
Atapour-Abarghouei, Amir ;
Breckon, Toby P. .
2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]  
Bergmann P., 2019, VISIGRAPP
[5]   Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4182-4191
[6]   MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9584-9592
[7]   Reducing Medication Errors Through Naming, Labeling, and Packaging [J].
Adrienne Berman .
Journal of Medical Systems, 2004, 28 (1) :9-29
[8]   Mixed supervision for surface-defect detection: From weakly to fully supervised learning [J].
Bozic, Jakob ;
Tabernik, Domen ;
Skocaj, Danijel .
COMPUTERS IN INDUSTRY, 2021, 129
[9]   Automated visual inspection of imprinted pharmaceutical tablets [J].
Bukovec, Marko ;
Spiclin, Ziga ;
Pernus, Franjo ;
Likar, Bostjan .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2007, 18 (09) :2921-2930
[10]  
Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, 10.48550/arXiv.1706.05587]