Out-of-Distribution Detection Based on Multiple Metrics Fusion of Network Hidden Features

被引:0
|
作者
Zhu, Qiuyu [1 ]
He, Yiwei [1 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Measurement; Training; Data models; Semantics; Neural networks; Data mining; Uncertainty; Training data; Posterior probability; Pattern recognition; Out-of-distribution detection; hidden features; pattern recognition; multiple metrics fusion;
D O I
10.1109/ACCESS.2024.3471693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional pattern recognition models achieve excellent classification performance. However, when out-of-distribution (OOD) samples, which are outside the training distribution of in-distribution (ID) data, are input into the model, the model often assigns excessively high confidence. Simply using the probability information of the output classification from the network for OOD detection does not yield satisfactory results. The paper starts with the hidden feature information from the intermediate layers of neural networks to design discriminative metrics, including the modulus ratio of input and output from the convolutional layers and the feature distribution differences of the Batch Normalization (BN) layers within the network. Combined with the OOD detection model based on predefined evenly-distribution class centroids (PEDCC)-Loss, we propose a fusion metric selection strategy. This strategy selects appropriate feature metrics for multi-feature fusion to achieve optimal detection capability for both ID and OOD samples simultaneously. Our method requires only training the classification network model, without any input pre-processing or specific OOD data pre-tuning. Extensive experiments on several benchmark datasets show that our approach achieves state-of-the-art performance in simultaneously recognizing ID and OOD samples while ensuring that the recognition rate of ID samples does not decrease. The code for the paper can be found at https://github.com/Hewell0/HiddenOOD.
引用
收藏
页码:145450 / 145458
页数:9
相关论文
共 50 条
  • [41] Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detection
    Zhou, Yibo
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7369 - 7377
  • [42] Exploiting classifier inter-level features for efficient out-of-distribution detection
    Fayyad, Jamil
    Gupta, Kashish
    Mahdian, Navid
    Gruyer, Dominique
    Najjaran, Homayoun
    Image and Vision Computing, 2024, 142
  • [43] Out-of-Distribution (OOD) Detection Based on Deep Learning: A Review
    Cui, Peng
    Wang, Jinjia
    ELECTRONICS, 2022, 11 (21)
  • [44] Revisit PCA-based technique for Out-of-Distribution Detection
    Guan, Xiaoyuan
    Liu, Zhouwu
    Zheng, Wei-Shi
    Zhou, Yuren
    Wang, Ruixuan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 19374 - 19382
  • [45] Trustworthy diagnosis of Electrocardiography signals based on out-of-distribution detection
    Yu, Bowen
    Liu, Yuhong
    Wu, Xin
    Ren, Jing
    Zhao, Zhibin
    PLOS ONE, 2025, 20 (02):
  • [46] In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluation
    Bitterwolf, Julian
    Mueller, Maximilian
    Hein, Matthias
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202
  • [47] Exploiting classifier inter-level features for efficient out-of-distribution detection
    Fayyad, Jamil
    Gupta, Kashish
    Mahdian, Navid
    Gruyer, Dominique
    Najjaran, Homayoun
    IMAGE AND VISION COMPUTING, 2024, 142
  • [48] Towards In-Distribution Compatible Out-of-Distribution Detection
    Wu, Boxi
    Jiang, Jie
    Ren, Haidong
    Du, Zifan
    Wang, Wenxiao
    Li, Zhifeng
    Cai, Deng
    He, Xiaofei
    Lin, Binbin
    Liu, Wei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10333 - 10341
  • [49] A Robot Grasp Relationship Detection Network Based on the Fusion of Multiple Features
    Chi, Jianning
    Wu, Xingrui
    Ma, Changqing
    Yu, Xiaosheng
    Wu, Chengdong
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1479 - 1484
  • [50] Out-of-Distribution Detection Using Outlier Detection Methods
    Diers, Jan
    Pigorsch, Christian
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 15 - 26