Effective Out-of-Distribution Detection in Classifier Based on PEDCC-Loss

被引:2
作者
Zhu, Qiuyu [1 ]
Zheng, Guohui [1 ]
Yan, Yingying [2 ]
机构
[1] ShangHai Univ, Sch Commun & Informat Engn, 99 ShangDa Rd, Shanghai 200444, Peoples R China
[2] ShangHai Univ, Coll Sci, 99 ShangDa Rd, Shanghai 200444, Peoples R China
关键词
Classifier; In-distribution; Out-of-distribution detection; PEDCC-Loss;
D O I
10.1007/s11063-022-10970-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. It is an urgent and challenging task to detect these samples drawn far away from training distribution based on the security considerations of artificial intelligence. Many existing methods based on neural networks mainly rely on complex processing strategies, such as temperature scaling and input preprocessing, to obtain satisfactory results. In this paper, we propose an effective algorithm for detecting out-of-distribution examples utilizing PEDCC-Loss. We mathematically analyze the nature of the confidence score output by the PEDCC (Predefined Evenly-Distribution Class Centroids) classifier and then construct a more effective scoring function to distinguish in-distribution (ID) and out-of-distribution samples. In this method, there is no need to preprocess the input samples and the computational burden of the algorithm is reduced. Experiments demonstrate that our method can achieve better OOD detection performance than Softmax-based methods.
引用
收藏
页码:1937 / 1949
页数:13
相关论文
共 28 条
  • [1] Andrews J., 2016, J. Mach. Learn. Res.
  • [2] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [3] Evtimov I., 2017, arXiv preprint:1707.08945
  • [4] An introduction to ROC analysis
    Fawcett, Tom
    [J]. PATTERN RECOGNITION LETTERS, 2006, 27 (08) : 861 - 874
  • [5] Gawlikowski J, 2021, ARXIV
  • [6] He K., 2016, IEEE C COMP VIS PATT, DOI DOI 10.1109/CVPR.2016.90
  • [7] Hendrycks D, 2017, P INT C LEARNING REP
  • [8] Hsu YC, 2020, PROC CVPR IEEE, P10948, DOI 10.1109/CVPR42600.2020.01096
  • [9] Hu H, 2021, GENERATION FRAME CHA
  • [10] HUANG G, 2017, PROC CVPR IEEE, P2261, DOI [10.1109/CVPR.2017.243, DOI 10.1109/CVPR.2017.243]