Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features

被引:0
|
作者
Zhu, Qiuyu [1 ]
He, Yiwei [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Measurement; Training; Data models; Semantics; Neural networks; Data mining; Uncertainty; Training data; Posterior probability; Pattern recognition; Out-of-distribution detection; hidden features; pattern recognition; multiple metrics fusion;
D O I
10.1109/ACCESS.2024.3471693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional pattern recognition models achieve excellent classification performance. However, when out-of-distribution (OOD) samples, which are outside the training distribution of in-distribution (ID) data, are input into the model, the model often assigns excessively high confidence. Simply using the probability information of the output classification from the network for OOD detection does not yield satisfactory results. The paper starts with the hidden feature information from the intermediate layers of neural networks to design discriminative metrics, including the modulus ratio of input and output from the convolutional layers and the feature distribution differences of the Batch Normalization (BN) layers within the network. Combined with the OOD detection model based on predefined evenly-distribution class centroids (PEDCC)-Loss, we propose a fusion metric selection strategy. This strategy selects appropriate feature metrics for multi-feature fusion to achieve optimal detection capability for both ID and OOD samples simultaneously. Our method requires only training the classification network model, without any input pre-processing or specific OOD data pre-tuning. Extensive experiments on several benchmark datasets show that our approach achieves state-of-the-art performance in simultaneously recognizing ID and OOD samples while ensuring that the recognition rate of ID samples does not decrease. The code for the paper can be found at https://github.com/Hewell0/HiddenOOD.
引用
收藏
页码:145450 / 145458
页数:9
相关论文
共 50 条
  • [21] Latent Transformer Models for out-of-distribution detection
    Graham, Mark S.
    Tudosiu, Petru-Daniel
    Wright, Paul
    Pinaya, Walter Hugo Lopez
    Teikari, Petteri
    Patel, Ashay
    U-King-Im, Jean-Marie
    Mah, Yee H.
    Teo, James T.
    Jager, Hans Rolf
    Werring, David
    Rees, Geraint
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    MEDICAL IMAGE ANALYSIS, 2023, 90
  • [22] Average of Pruning: Improving Performance and Stability of Out-of-Distribution Detection
    Cheng, Zhen
    Zhu, Fei
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025,
  • [23] Characterizing Submanifold Region for Out-of-Distribution Detection
    Li, Xuhui
    Fang, Zhen
    Zhang, Yonggang
    Ma, Ning
    Bu, Jiajun
    Han, Bo
    Wang, Haishuai
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (01) : 130 - 147
  • [24] Classifier-Head Informed Feature Masking and Prototype-Based Logit Smoothing for Out-of-Distribution Detection
    Sun, Zhuohao
    Qiu, Yiqiao
    Tan, Zhijun
    Zheng, Weishi
    Wang, Ruixuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5630 - 5640
  • [25] Out-of-distribution detection based on multi-classifiers
    Jiang, Weijie
    Yu, Yuanlong
    COGNITIVE COMPUTATION AND SYSTEMS, 2023, 5 (02) : 95 - 108
  • [26] Transformer-based out-of-distribution detection for clinically safe segmentation
    Graham, Mark S.
    Tudosiu, Petru-Daniel
    Wright, Paul
    Pinaya, Walter Hugo Lopez
    U-King-Im, Jean-Marie
    Mah, Yee H.
    Teo, James T.
    Jager, Rolf
    Werring, David
    Nachev, Parashkev
    Ourselin, Sebastien
    Cardoso, M. Jorge
    INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 172, 2022, 172 : 457 - 475
  • [27] Enhancing Out-of-Distribution Detection with Multitesting-based Layer-wise Feature Fusion
    Li, Jiawei
    Li, Sitong
    Wang, Shanshan
    Zeng, Yicheng
    Tan, Falong
    Xie, Chuanlong
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 510 - 517
  • [28] Exploring using jigsaw puzzles for out-of-distribution detection
    Yu, Yeonguk
    Shin, Sungho
    Ko, Minhwan
    Lee, Kyoobin
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241
  • [29] RankFeat&RankWeight: Rank-1 Feature/Weight Removal for Out-of-Distribution Detection
    Song, Yue
    Wang, Wei
    Sebe, Nicu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) : 2505 - 2519
  • [30] Semantic enhanced for out-of-distribution detection
    Jiang, Weijie
    Yu, Yuanlong
    FRONTIERS IN NEUROROBOTICS, 2022, 16