Half-AUC for the evaluation of sensitive or specific classifiers

被引:7
作者
Bradley, Andrew P. [1 ]
机构
[1] Univ Queensland, Sch Informat Technol & Elect Engn, St Lucia, Qld 4072, Australia
基金
澳大利亚研究理事会;
关键词
ROC curves; AUC; Specificity; Sensitivity; Partial-AUC; ROC CURVE; AREA;
D O I
10.1016/j.patrec.2013.11.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes a simple, non-parametric variant of area under the receiver operating characteristic (ROC) curve (AUC), which we call half-AUC (HAUC). By measuring AUC in two halves: first when the true positive rate (TPR) is greater than the true negative rate (TNR) and then when TPR is less than TNR, we obtain a measure of a classifier's overall sensitivity (HAUC(Se)) and specificity (HAUC(Sp)) respectively. We show that these HAUC measures can be interpreted as the probability of correct ranking under the constraint that one class must have a higher detection rate than the other. We then go on to describe application domains where this constraint is appropriate and hence where HAUC may be superior to AUC. We show examples where HAUC discriminates ROC curves both when one curve dominates another and when the curves cross, but have an equivalent AUC. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:93 / 98
页数:6
相关论文
共 19 条
[1]  
[Anonymous], 1999, Biostatistical Analysis
[2]   Caveats and pitfalls of ROC analysis in clinical microarray research (and how to avoid them) [J].
Berrar, Daniel ;
Flach, Peter .
BRIEFINGS IN BIOINFORMATICS, 2012, 13 (01) :83-97
[3]  
Bradley A., 1994, Proceedings of the 1994 Second Australian and New Zealand Conference on Intelligent Information Systems (Cat. No.94TH8019), P37, DOI 10.1109/ANZIIS.1994.396954
[4]   ROC curve equivalence using the Kolmogorov-Smirnov test [J].
Bradley, Andrew P. .
PATTERN RECOGNITION LETTERS, 2013, 34 (05) :470-475
[5]   The use of the area under the roc curve in the evaluation of machine learning algorithms [J].
Bradley, AP .
PATTERN RECOGNITION, 1997, 30 (07) :1145-1159
[6]   ADVANCES IN STATISTICAL METHODOLOGY FOR THE EVALUATION OF DIAGNOSTIC AND LABORATORY TESTS [J].
CAMPBELL, G .
STATISTICS IN MEDICINE, 1994, 13 (5-7) :499-508
[7]   Partial AUC estimation and regression [J].
Dodd, LE ;
Pepe, MS .
BIOMETRICS, 2003, 59 (03) :614-623
[8]   Cost curves: An improved method for visualizing classifier performance [J].
Drummond, Chris ;
Holte, Robert C. .
MACHINE LEARNING, 2006, 65 (01) :95-130
[9]   An introduction to ROC analysis [J].
Fawcett, Tom .
PATTERN RECOGNITION LETTERS, 2006, 27 (08) :861-874
[10]  
Ferri C., 2011, P 28 INT C MACH LEAR, P657