Patch Feature Transformation: An Anomaly Detection Method with Succinct Feature Filtering

被引:0
作者
Guo, Yaohua [1 ,2 ]
Xu, Guoai [1 ,2 ]
Yin, Jianping [2 ,3 ]
Wang, Siqi [2 ,4 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[2] Great Bay Univ, Sch Comp & Informat Technol, Dongguan 523000, Peoples R China
[3] Dongguan Univ Technol, Sch Comp Sci & Technol, Dongguan 523808, Peoples R China
[4] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; data preprocessing; feature filtering; sample labeling;
D O I
10.1142/S0218001425590062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection is often approached as an out-of-distribution (OOD) detection task, where a feature distribution from normal samples is constructed, and deviations are flagged as anomalies. This approach is dependent on manual labeling, as subtle visual anomalies can be easily overlooked, resulting in the potential for bias in labeling and subsequent unsatisfactory detection results. Based on the issue, we propose Anomaly Detection with Succinct Feature Filtering (ADSFF) for unlabeled samples. Our method avoids sample labeling bias and provides a solution to the coexistence of anomalous and normal features in the feature space of unlabeled samples. ADSFF includes a data preprocessing module and a feature filtering module, where the data preprocessing module improves the visibility of subtle anomalies, while the feature filtering module screens the local features of the samples. In feature filtering, we found that feedforward neural networks do not lose feature information during the feature transformation process. Consequently, we utilized feedforward neural networks for feature filtering and achieved expected results. Furthermore, we investigate the impact of sample imbalance on the task of anomaly detection using unlabeled samples. This paper assesses the performance of ADSFF using the MVTec AD and BeanTech Anomaly Detection (BTAD) datasets. The results demonstrate that ADSFF achieves an average area under the curve (AUC) of 0.978 on the MVTec AD and an average AUC of 0.942 on the BTAD. ADSFF outperformed other methods on seven test datasets in MVTec AD, achieving the highest average accuracy on MVTec AD.
引用
收藏
页数:25
相关论文
共 44 条
[1]   MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection [J].
Bergmann, Paul ;
Fauser, Michael ;
Sattlegger, David ;
Steger, Carsten .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9584-9592
[2]   Network Anomaly Detection With Stacked Sparse Shrink Variational Autoencoders and Unbalanced XGBoost [J].
Bi, Jing ;
Guan, Ziyue ;
Yuan, Haitao ;
Yang, Jinhong ;
Zhang, Jia .
IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2025, 10 (01) :28-38
[3]   Instance-Specific Semantic Augmentation for Long-Tailed Image Classification [J].
Chen, Jiahao ;
Su, Bing .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 :2544-2557
[4]   A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Images [J].
Cui, Yajie ;
Liu, Zhaoxiang ;
Lian, Shiguo .
IEEE ACCESS, 2023, 11 :55297-55315
[5]  
Dai SM, 2024, AAAI CONF ARTIF INTE, P1454
[6]   Few-shot Network Anomaly Detection via Cross-network Meta-learning [J].
Ding, Kaize ;
Zhou, Qinghai ;
Tong, Hanghang ;
Liu, Huan .
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, :2448-2456
[7]   Unsupervised anomaly detection via knowledge distillation with non-directly-coupled student block fusion [J].
Feng, Zhiyuan ;
Chen, Ying ;
Xie, Linbo .
MACHINE VISION AND APPLICATIONS, 2023, 34 (06)
[8]   An unsupervised anomaly detection framework for onboard monitoring of railway track geometrical defects using one-class support vector machine [J].
Ghiasi, Ramin ;
Khan, Muhammad Arslan ;
Sorrentino, Danilo ;
Diaine, Cassandre ;
Malekjafarian, Abdollah .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
[9]   CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flows [J].
Gudovskiy, Denis ;
Ishizaka, Shun ;
Kozuka, Kazuki .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :1819-1828
[10]  
Guo Y., 2023, INT J PATTERN RECOGN, V37, P2351007