AdvSCOD: Bayesian-Based Out-Of-Distribution Detection via Curvature Sketching and Adversarial Sample Enrichment

被引:1
|
作者
Qiao, Jiacheng [1 ]
Zhong, Chengzhi [1 ]
Zhu, Peican [2 ]
Tang, Keke [1 ,3 ]
机构
[1] Guangzhou Univ, Cyberspace Inst Adv Technol, Guangzhou 510006, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Peng Cheng Lab, Dept New Networks, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
OOD detection; Bayesian posterior; uncertainty; adversarial perturbation; sample enrichment;
D O I
10.3390/math11030692
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Detecting out-of-distribution (OOD) samples is critical for the deployment of deep neural networks (DNN) in real-world scenarios. An appealing direction in which to conduct OOD detection is to measure the epistemic uncertainty in DNNs using the Bayesian model, since it is much more explainable. SCOD sketches the curvature of DNN classifiers based on Bayesian posterior estimation and decomposes the OOD measurement into the uncertainty of the model parameters and the influence of input samples on the DNN models. However, since lots of approximation is applied, and the influence of the input samples on DNN models can be hardly measured stably, as demonstrated in adversarial attacks, the detection is not robust. In this paper, we propose a novel AdvSCOD framework that enriches the input sample with a small set of its neighborhoods generated by applying adversarial perturbation, which we believe can better reflect the influence on model predictions, and then we average their uncertainties, measured by SCOD. Extensive experiments with different settings of in-distribution and OOD datasets validate the effectiveness of AdvSCOD in OOD detection and its superiority to state-of-the-art Bayesian-based methods. We also evaluate the influence of different types of perturbation.
引用
收藏
页数:15
相关论文
共 13 条
  • [1] Out-of-Distribution (OOD) Detection and Generalization Improved by Augmenting Adversarial Mixup Samples
    Gwon, Kyungpil
    Yoo, Joonhyuk
    ELECTRONICS, 2023, 12 (06)
  • [2] WOOD: Wasserstein-Based Out-of-Distribution Detection
    Wang, Yinan
    Sun, Wenbo
    Jin, Jionghua
    Kong, Zhenyu
    Yue, Xiaowei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (02) : 944 - 956
  • [3] Fine-grained medical image out-of-distribution detection through multi-view feature uncertainty and adversarial sample generation
    Wei, Jie
    Wang, Guotai
    Zhang, Shaoting
    PATTERN RECOGNITION, 2025, 162
  • [4] A Novel Data Augmentation Technique for Out-of-Distribution Sample Detection Using Compounded Corruptions
    Hebbalaguppe, Ramya
    Ghosal, Soumya Suvra
    Prakash, Jatin
    Khadilkar, Harshad
    Arora, Chetan
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT III, 2023, 13715 : 529 - 545
  • [5] Transformer-based out-of-distribution detection for clinically safe segmentation
    Graham, Mark S.
    Tudosiu, Petru-Daniel
    Wright, Paul
    Pinaya, Walter Hugo Lopez
    U-King-Im, Jean-Marie
    Mah, Yee H.
    Teo, James T.
    Jager, Rolf
    Werring, David
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 172, 2022, 172 : 457 - 475
  • [6] Improving Energy-Based Out-of-Distribution Detection by Sparsity Regularization
    Chen, Qichao
    Jiang, Wenjie
    Li, Kuan
    Wang, Yi
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2022, PT II, 2022, 13281 : 539 - 551
  • [7] FlowCon: Out-of-Distribution Detection Using Flow-Based Contrastive Learning
    Aathreya, Saandeep
    Canavan, Shaun
    COMPUTER VISION - ECCV 2024, PT XVI, 2025, 15074 : 192 - 209
  • [8] Out-of-Distribution Detection of Unknown False Data Injection Attack With Logit-Normalized Bayesian ResNet
    Feng, Guangxu
    Lao, Keng-Weng
    Chen, Ge
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (06) : 6005 - 6017
  • [9] Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features
    Zhu, Qiuyu
    He, Yiwei
    IEEE ACCESS, 2024, 12 : 145450 - 145458
  • [10] Classification of incunable glyphs and out-of-distribution detection with joint energy-based models
    Florian Kordon
    Nikolaus Weichselbaumer
    Randall Herz
    Stephen Mossman
    Edward Potten
    Mathias Seuret
    Martin Mayr
    Vincent Christlein
    International Journal on Document Analysis and Recognition (IJDAR), 2023, 26 : 223 - 240