Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features

被引:0
|
作者
Zhu, Qiuyu [1 ]
He, Yiwei [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Measurement; Training; Data models; Semantics; Neural networks; Data mining; Uncertainty; Training data; Posterior probability; Pattern recognition; Out-of-distribution detection; hidden features; pattern recognition; multiple metrics fusion;
D O I
10.1109/ACCESS.2024.3471693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional pattern recognition models achieve excellent classification performance. However, when out-of-distribution (OOD) samples, which are outside the training distribution of in-distribution (ID) data, are input into the model, the model often assigns excessively high confidence. Simply using the probability information of the output classification from the network for OOD detection does not yield satisfactory results. The paper starts with the hidden feature information from the intermediate layers of neural networks to design discriminative metrics, including the modulus ratio of input and output from the convolutional layers and the feature distribution differences of the Batch Normalization (BN) layers within the network. Combined with the OOD detection model based on predefined evenly-distribution class centroids (PEDCC)-Loss, we propose a fusion metric selection strategy. This strategy selects appropriate feature metrics for multi-feature fusion to achieve optimal detection capability for both ID and OOD samples simultaneously. Our method requires only training the classification network model, without any input pre-processing or specific OOD data pre-tuning. Extensive experiments on several benchmark datasets show that our approach achieves state-of-the-art performance in simultaneously recognizing ID and OOD samples while ensuring that the recognition rate of ID samples does not decrease. The code for the paper can be found at https://github.com/Hewell0/HiddenOOD.
引用
收藏
页码:145450 / 145458
页数:9
相关论文
共 50 条
  • [31] An Advanced Dirichlet Prior Network for Out-of-Distribution Detection in Remote Sensing
    Gawlikowski, Jakob
    Saha, Sudipan
    Kruspe, Anna
    Zhu, Xiao Xiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [32] Exploring the Limits of Out-of-Distribution Detection
    Fort, Stanislav
    Ren, Jie
    Lakshminarayanan, Balaji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [33] On Risk Assessment for Out-of-Distribution Detection
    Vasiliuk, Anton
    IEEE ACCESS, 2025, 13 : 18546 - 18568
  • [34] Semantic enhanced for out-of-distribution detection
    Jiang, Weijie
    Yu, Yuanlong
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [35] Likelihood Ratios for Out-of-Distribution Detection
    Ren, Jie
    Liu, Peter J.
    Fertig, Emily
    Snoek, Jasper
    Poplin, Ryan
    DePristo, Mark A.
    Dillon, Joshua V.
    Lakshminarayanan, Balaji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [36] Semantically Coherent Out-of-Distribution Detection
    Yang, Jingkang
    Wang, Haoqi
    Feng, Litong
    Yan, Xiaopeng
    Zheng, Huabin
    Zhang, Wayne
    Liub, Ziwei
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8281 - 8289
  • [37] Generalized Out-of-Distribution Detection: A Survey
    Yang, Jingkang
    Zhou, Kaiyang
    Li, Yixuan
    Liu, Ziwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (12) : 5635 - 5662
  • [38] Unsupervised evaluation for out-of-distribution detection
    Zhang, Yuhang
    Hu, Jiani
    Wen, Dongchao
    Deng, Weihong
    PATTERN RECOGNITION, 2025, 160
  • [39] Evidence Reconciled Neural Network for Out-of-Distribution Detection in Medical Images
    Fu, Wei
    Chen, Yufei
    Liu, Wei
    Yue, Xiaodong
    Ma, Chao
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT III, 2023, 14222 : 305 - 315
  • [40] Inductive Conformal Out-of-distribution Detection based on Adversarial Autoencoders
    Cai, Feiyang
    Ozdagli, Ali, I
    Potteiger, Nicholas
    Koutsoukos, Xenofon
    2021 IEEE INTERNATIONAL CONFERENCE ON OMNI-LAYER INTELLIGENT SYSTEMS (IEEE COINS 2021), 2021, : 90 - 95