Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features

被引:0
|
作者
Zhu, Qiuyu [1 ]
He, Yiwei [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Measurement; Training; Data models; Semantics; Neural networks; Data mining; Uncertainty; Training data; Posterior probability; Pattern recognition; Out-of-distribution detection; hidden features; pattern recognition; multiple metrics fusion;
D O I
10.1109/ACCESS.2024.3471693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional pattern recognition models achieve excellent classification performance. However, when out-of-distribution (OOD) samples, which are outside the training distribution of in-distribution (ID) data, are input into the model, the model often assigns excessively high confidence. Simply using the probability information of the output classification from the network for OOD detection does not yield satisfactory results. The paper starts with the hidden feature information from the intermediate layers of neural networks to design discriminative metrics, including the modulus ratio of input and output from the convolutional layers and the feature distribution differences of the Batch Normalization (BN) layers within the network. Combined with the OOD detection model based on predefined evenly-distribution class centroids (PEDCC)-Loss, we propose a fusion metric selection strategy. This strategy selects appropriate feature metrics for multi-feature fusion to achieve optimal detection capability for both ID and OOD samples simultaneously. Our method requires only training the classification network model, without any input pre-processing or specific OOD data pre-tuning. Extensive experiments on several benchmark datasets show that our approach achieves state-of-the-art performance in simultaneously recognizing ID and OOD samples while ensuring that the recognition rate of ID samples does not decrease. The code for the paper can be found at https://github.com/Hewell0/HiddenOOD.
引用
收藏
页码:145450 / 145458
页数:9
相关论文
共 50 条
  • [41] Improving Out-of-Distribution Detection by Learning From the Deployment Environment
    Inkawhich, Nathan
    Zhang, Jingyang
    Davis, Eric K.
    Luley, Ryan
    Chen, Yiran
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 2070 - 2086
  • [42] Language Models as Reasoners for Out-of-Distribution Detection
    Kirchheim, Konstantin
    Ortmeier, Frank
    COMPUTER SAFETY, RELIABILITY, AND SECURITY. SAFECOMP 2024 WORKSHOPS, 2024, 14989 : 379 - 390
  • [43] Weighted Mutual Information for Out-Of-Distribution Detection
    De Bernardi, Giacomo
    Narteni, Sara
    Cambiaso, Enrico
    Muselli, Marco
    Mongelli, Maurizio
    EXPLAINABLE ARTIFICIAL INTELLIGENCE, XAI 2023, PT III, 2023, 1903 : 318 - 331
  • [44] Decomposing texture and semantic for out-of-distribution detection
    Moon, Jeong-Hyeon
    Ahn, Namhyuk
    Sohn, Kyung-Ah
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [45] Out-of-Distribution Detection with Virtual Outlier Smoothing
    Nie, Jun
    Luo, Yadan
    Ye, Shanshan
    Zhang, Yonggang
    Tian, Xinmei
    Fang, Zhen
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (02) : 724 - 741
  • [46] Full-Spectrum Out-of-Distribution Detection
    Yang, Jingkang
    Zhou, Kaiyang
    Liu, Ziwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (10) : 2607 - 2622
  • [47] DICE: Leveraging Sparsification for Out-of-Distribution Detection
    Sun, Yiyou
    Li, Yixuan
    COMPUTER VISION, ECCV 2022, PT XXIV, 2022, 13684 : 691 - 708
  • [48] Gradient-Regularized Out-of-Distribution Detection
    Sharifi, Sina
    Entesari, Taha
    Safaei, Bardia
    Patel, Vishal M.
    Fazlyab, Mahyar
    COMPUTER VISION - ECCV 2024, PT XIII, 2025, 15071 : 459 - 478
  • [49] Full-Spectrum Out-of-Distribution Detection
    Jingkang Yang
    Kaiyang Zhou
    Ziwei Liu
    International Journal of Computer Vision, 2023, 131 : 2607 - 2622
  • [50] Gaussian-Based Approach for Out-of-Distribution Detection in Deep Learning
    Carvalho, Thiago
    Vellasco, Marley
    Amaral, Jose Franco
    24TH INTERNATIONAL CONFERENCE ON ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EAAAI/EANN 2023, 2023, 1826 : 303 - 314