Partial AUC and optimal thresholds

被引:1
作者
Hong, Chong Sun [1 ]
Cho, Hyun Su [1 ]
机构
[1] Sungkyunkwan Univ, Dept Stat, 25-2 Sungkyunkwan Ro, Seoul 03063, South Korea
关键词
accuracy; classification; confusion matrix; default; optimal threshold; ROC CURVE; ACCURACY; AREA;
D O I
10.5351/KJAS.2019.32.2.187
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Extensive literature exists on how to estimate optimal thresholds based on various accuracy measures using receiver operating characteristic (ROC) and cumulative accuracy profile (CAP) curves. This paper now proposes an alternative measure to represented the specific partial area under the ROC and CAP curves. The relationship between ROC and CAP functions is examined using differential equations of the new defined partial area under curves. In addition, the relationship with the optimal thresholds under conditions of various accuracy measures for the ROC and CAP functions is also derived. We assume there are two kinds of distribution functions composing the mixed distribution as various normal distributions before finding the optimal thresholds. Corresponding type 1 and 2 errors are also explored and discussed under various conditions for accuracy measures.
引用
收藏
页码:187 / 198
页数:12
相关论文
共 33 条
[1]  
BERRY MJA, 1999, DATA MINING TECHNIQU
[2]   The use of the area under the roc curve in the evaluation of machine learning algorithms [J].
Bradley, AP .
PATTERN RECOGNITION, 1997, 30 (07) :1145-1159
[3]  
Brasil P., 2010, DIAGNOSISMED DIAGN T
[4]   SIGNAL DETECTABILITY - THE USE OF ROC CURVES AND THEIR ANALYSES [J].
CENTOR, RM .
MEDICAL DECISION MAKING, 1991, 11 (02) :102-106
[5]  
CONNELL FA, 1985, AM J EPIDEMIOL, V121, P744
[6]   Partial AUC estimation and regression [J].
Dodd, LE ;
Pepe, MS .
BIOMETRICS, 2003, 59 (03) :614-623
[7]  
Engelmann B., 2003, DISCUSSION PAPER SER, V01
[8]  
Fawcett T., 2003, ROC graphs: notes and practical considerations for data mining researchers
[9]   An introduction to ROC analysis [J].
Fawcett, Tom .
PATTERN RECOGNITION LETTERS, 2006, 27 (08) :861-874
[10]   Optimal Thresholds from Mixture Distributions [J].
Hong, Chong Sun ;
Joo, Jae Seon ;
Choi, Jin Soo .
KOREAN JOURNAL OF APPLIED STATISTICS, 2010, 23 (01) :13-28