Few-shot anomaly detection using positive unlabeled learning with cycle consistency and co-occurrence features

被引:5
作者
An, Sion [1 ,2 ]
Kim, Jaehong [5 ]
Kim, Soopil [1 ]
Chikontwe, Philip [3 ]
Jung, Jiwook [4 ]
Jeon, Hyejeong [4 ]
Park, Sang Hyun [1 ,2 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol DGIST, Dept Robot & Mechatron Engn, Daegu, South Korea
[2] Univ Penn, Dept Biostat Epidemiol & Informat, Philadelphia, PA USA
[3] Harvard Med Sch, Dept Biomed Informat, Boston, MA USA
[4] LG Elect, Artificial Intelligence Lab, Seoul, South Korea
[5] Korea Adv Inst Sci & Technol KAIST, Sch Comp, Daejeon, South Korea
关键词
Anomaly detection; Defect detection; Few-shot learning; Positive unlabeled learning;
D O I
10.1016/j.eswa.2024.124890
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In industrial manufacturing sites, defect detection is crucial to improve reliability and lower inspection costs. Though prior anomaly detectors have shown success, they rely on large amounts of labeled data. Now, we aim to answer "how to cost-effectively utilize limited data for defect detection?''. . Inspired by positive and unlabeled learning and few-shot learning, we propose a Positive Unlabeled learning based Few-shot Anomaly Detection model (PUFAD) that builds a representative memory bank of patch features using the large unlabeled set and few normal samples. Frequently co-occurring patch features in the unlabeled set, and cycle-consistent features between normal and unlabeled samples are regarded as pseudo normal features used for classifier training, including memory bank updates. Given test samples during inference, abnormal samples are detected by comparing the features in the memory bank via density estimation. Our method achieves state-of-theart performance compared to existing few-shot anomaly detection methods on two benchmarks. This work addresses the real-world challenges of collecting large datasets for visual anomaly detection by proposing a practical solution that requires only a few normal samples and unlabeled data.
引用
收藏
页数:12
相关论文
共 69 条
[41]   Anomaly-GAN: A data augmentation method for train surface anomaly detection [J].
Liu, Ruikang ;
Liu, Weiming ;
Zheng, Zhongxing ;
Wang, Liang ;
Mao, Liang ;
Qiu, Qisheng ;
Ling, Guangzheng .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 228
[42]  
Mignone P., 2022, 2022 IEEE INT C BIG, P5536, DOI [10.1109/BigData55660.2022.10020270, DOI 10.1109/BIGDATA55660.2022.10020270]
[43]   Distributed Heterogeneous Transfer Learning [J].
Mignone, Paolo ;
Pio, Gianvito ;
Ceci, Michelangelo .
BIG DATA RESEARCH, 2024, 37
[44]   Teacher-student network for 3D point cloud anomaly detection with few normal samples [J].
Qin, Jianjian ;
Gu, Chunzhi ;
Yu, Jun ;
Zhang, Chao .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 228
[45]   Detecting out-of-distribution samples via variational auto-encoder with reliable uncertainty estimation [J].
Ran, Xuming ;
Xu, Mingkun ;
Mei, Lingrui ;
Xu, Qi ;
Liu, Quanying .
NEURAL NETWORKS, 2022, 145 :199-208
[46]  
Robinson J., 2021, INT C LEARNING REPRE
[47]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[48]   Towards Total Recall in Industrial Anomaly Detection [J].
Roth, Karsten ;
Pemula, Latha ;
Zepeda, Joaquin ;
Scholkopf, Bernhard ;
Brox, Thomas ;
Gehler, Peter .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :14298-14308
[49]   Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection [J].
Rudolph, Marco ;
Wehrbein, Tom ;
Rosenhahn, Bodo ;
Wandt, Bastian .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :1829-1838
[50]   Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows [J].
Rudolph, Marco ;
Wandt, Bastian ;
Rosenhahn, Bodo .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :1906-1915