Effective Out-of-Distribution Detection in Classifier Based on PEDCC-Loss

被引:0
作者
Qiuyu Zhu
Guohui Zheng
Yingying Yan
机构
[1] ShangHai University,School of Communication and Information Engineering
[2] ShangHai University,College of Sciences
来源
Neural Processing Letters | 2023年 / 55卷
关键词
Classifier; In-distribution; Out-of-distribution detection; PEDCC-Loss;
D O I
暂无
中图分类号
学科分类号
摘要
Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. It is an urgent and challenging task to detect these samples drawn far away from training distribution based on the security considerations of artificial intelligence. Many existing methods based on neural networks mainly rely on complex processing strategies, such as temperature scaling and input preprocessing, to obtain satisfactory results. In this paper, we propose an effective algorithm for detecting out-of-distribution examples utilizing PEDCC-Loss. We mathematically analyze the nature of the confidence score output by the PEDCC (Predefined Evenly-Distribution Class Centroids) classifier and then construct a more effective scoring function to distinguish in-distribution (ID) and out-of-distribution samples. In this method, there is no need to preprocess the input samples and the computational burden of the algorithm is reduced. Experiments demonstrate that our method can achieve better OOD detection performance than Softmax-based methods.
引用
收藏
页码:1937 / 1949
页数:12
相关论文
共 9 条
[1]  
Fawcett T(2006)An introduction to roc analysis Pattern recognit lett 27 861-874
[2]  
Wang F(2018)Additive margin softmax for face verification IEEE Signal Process Lett 25 926-930
[3]  
Cheng J(2019)A new loss function for cnn classifier based on predefined evenly-distributed class centroids IEEE Access 8 10888-10895
[4]  
Liu W(undefined)undefined undefined undefined undefined-undefined
[5]  
Liu H(undefined)undefined undefined undefined undefined-undefined
[6]  
Zhu Qiuyu(undefined)undefined undefined undefined undefined-undefined
[7]  
Zhang Pengju(undefined)undefined undefined undefined undefined-undefined
[8]  
Wang Zhengyong(undefined)undefined undefined undefined undefined-undefined
[9]  
Ye Xin(undefined)undefined undefined undefined undefined-undefined