Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features

被引:0
|
作者
Zhu, Qiuyu [1 ]
He, Yiwei [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Measurement; Training; Data models; Semantics; Neural networks; Data mining; Uncertainty; Training data; Posterior probability; Pattern recognition; Out-of-distribution detection; hidden features; pattern recognition; multiple metrics fusion;
D O I
10.1109/ACCESS.2024.3471693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional pattern recognition models achieve excellent classification performance. However, when out-of-distribution (OOD) samples, which are outside the training distribution of in-distribution (ID) data, are input into the model, the model often assigns excessively high confidence. Simply using the probability information of the output classification from the network for OOD detection does not yield satisfactory results. The paper starts with the hidden feature information from the intermediate layers of neural networks to design discriminative metrics, including the modulus ratio of input and output from the convolutional layers and the feature distribution differences of the Batch Normalization (BN) layers within the network. Combined with the OOD detection model based on predefined evenly-distribution class centroids (PEDCC)-Loss, we propose a fusion metric selection strategy. This strategy selects appropriate feature metrics for multi-feature fusion to achieve optimal detection capability for both ID and OOD samples simultaneously. Our method requires only training the classification network model, without any input pre-processing or specific OOD data pre-tuning. Extensive experiments on several benchmark datasets show that our approach achieves state-of-the-art performance in simultaneously recognizing ID and OOD samples while ensuring that the recognition rate of ID samples does not decrease. The code for the paper can be found at https://github.com/Hewell0/HiddenOOD.
引用
收藏
页码:145450 / 145458
页数:9
相关论文
共 50 条
  • [1] An Efficient Data Augmentation Network for Out-of-Distribution Image Detection
    Lin, Cheng-Hung
    Lin, Cheng-Shian
    Chou, Po-Yung
    Hsu, Chen-Chien
    IEEE ACCESS, 2021, 9 : 35313 - 35323
  • [2] Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss
    Zhu, Qiuyu
    Zheng, Guohui
    Shen, Jiakang
    Wang, Rui
    IEEE ACCESS, 2022, 10 : 66190 - 66197
  • [3] A Simple Framework for Robust Out-of-Distribution Detection
    Hur, Youngbum
    Yang, Eunho
    Hwang, Sung Ju
    IEEE ACCESS, 2022, 10 : 23086 - 23097
  • [4] Out-of-Distribution Detection for Reliable Face Recognition
    Yu, Chang
    Zhu, Xiangyu
    Lei, Zhen
    Li, Stan Z.
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 710 - 714
  • [5] Entropic Out-of-Distribution Detection: Seamless Detection of Unknown Examples
    Macedo, David
    Ren, Tsang Ing
    Zanchettin, Cleber
    Oliveira, Adriano L. I.
    Ludermir, Teresa
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (06) : 2350 - 2364
  • [6] An Advanced Dirichlet Prior Network for Out-of-Distribution Detection in Remote Sensing
    Gawlikowski, Jakob
    Saha, Sudipan
    Kruspe, Anna
    Zhu, Xiao Xiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Out-of-Distribution Detection by Cross-Class Vicinity Distribution of In-Distribution Data
    Zhao, Zhilin
    Cao, Longbing
    Lin, Kun-Yu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13777 - 13788
  • [8] Graph Energy Variety Network-based Out-of-distribution Detection
    Zhong, Yan
    Shang, Ruobing
    Cai, Jianxiu
    Tang, Rui
    Wong, Dennis
    8TH INTERNATIONAL CONFERENCE ON BIG DATA AND INTERNET OF THINGS, BDIOT 2024, 2024, : 64 - 70
  • [9] Mitigating SAR Out-of-Distribution Overconfidence Based on Evidential Uncertainty
    Zhou, Xiaoyan
    Tang, Tao
    Sun, Zhongzhen
    Kuang, Gangyao
    Heikkila, Janne
    Liu, Li
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [10] SPN: A Method of Few-Shot Traffic Classification With Out-of-Distribution Detection Based on Siamese Prototypical Network
    Miao, Gongxun
    Wu, Guohua
    Zhang, Zhen
    Tong, Yongjie
    Lu, Bing
    IEEE ACCESS, 2023, 11 : 114403 - 114414