Few-shot anomaly detection using positive unlabeled learning with cycle consistency and co-occurrence features

被引:5
作者
An, Sion [1 ,2 ]
Kim, Jaehong [5 ]
Kim, Soopil [1 ]
Chikontwe, Philip [3 ]
Jung, Jiwook [4 ]
Jeon, Hyejeong [4 ]
Park, Sang Hyun [1 ,2 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol DGIST, Dept Robot & Mechatron Engn, Daegu, South Korea
[2] Univ Penn, Dept Biostat Epidemiol & Informat, Philadelphia, PA USA
[3] Harvard Med Sch, Dept Biomed Informat, Boston, MA USA
[4] LG Elect, Artificial Intelligence Lab, Seoul, South Korea
[5] Korea Adv Inst Sci & Technol KAIST, Sch Comp, Daejeon, South Korea
关键词
Anomaly detection; Defect detection; Few-shot learning; Positive unlabeled learning;
D O I
10.1016/j.eswa.2024.124890
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In industrial manufacturing sites, defect detection is crucial to improve reliability and lower inspection costs. Though prior anomaly detectors have shown success, they rely on large amounts of labeled data. Now, we aim to answer "how to cost-effectively utilize limited data for defect detection?''. . Inspired by positive and unlabeled learning and few-shot learning, we propose a Positive Unlabeled learning based Few-shot Anomaly Detection model (PUFAD) that builds a representative memory bank of patch features using the large unlabeled set and few normal samples. Frequently co-occurring patch features in the unlabeled set, and cycle-consistent features between normal and unlabeled samples are regarded as pseudo normal features used for classifier training, including memory bank updates. Given test samples during inference, abnormal samples are detected by comparing the features in the memory bank via density estimation. Our method achieves state-of-theart performance compared to existing few-shot anomaly detection methods on two benchmarks. This work addresses the real-world challenges of collecting large datasets for visual anomaly detection by proposing a practical solution that requires only a few normal samples and unlabeled data.
引用
收藏
页数:12
相关论文
共 69 条
[1]   GANomaly: Semi-supervised Anomaly Detection via Adversarial Training [J].
Akcay, Samet ;
Atapour-Abarghouei, Amir ;
Breckon, Toby P. .
COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 :622-637
[2]   Dual Attention Relation Network With Fine-Tuning for Few-Shot EEG Motor Imagery Classification [J].
An, Sion ;
Kim, Soopil ;
Chikontwe, Philip ;
Park, Sang Hyun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) :15479-15493
[3]   Few-Shot Relation Learning with Attention for EEG-based Motor Imagery Classification [J].
An, Sion ;
Kim, Soopil ;
Chikontwe, Philip ;
Park, Sang Hyun .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :10933-10938
[4]   Surface defect detection methods for industrial products with imbalanced samples: A review of progress in the 2020s [J].
Bai, Dongxu ;
Li, Gongfa ;
Jiang, Du ;
Yun, Juntong ;
Tao, Bo ;
Jiang, Guozhang ;
Sun, Ying ;
Ju, Zhaojie .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130
[5]   MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9584-9592
[6]   Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images [J].
Cai, Yu ;
Chen, Hao ;
Yang, Xin ;
Zhou, Yu ;
Cheng, Kwang-Ting .
MEDICAL IMAGE ANALYSIS, 2023, 86
[7]   Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessment [J].
Cao, Yue ;
Wan, Zhaolin ;
Ren, Dongwei ;
Yan, Zifei ;
Zuo, Wangmeng .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5841-5851
[8]   Learning Student Networks in the Wild [J].
Chen, Hanting ;
Guo, Tianyu ;
Xu, Chang ;
Li, Wenshuo ;
Xu, Chunjing ;
Xu, Chao ;
Wang, Yunhe .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :6424-6433
[9]   CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification [J].
Chikontwe, Philip ;
Kim, Soopil ;
Park, Sang Hyun .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :14534-14543
[10]  
Cohen N, 2021, Arxiv, DOI arXiv:2005.02357