A comparative study of performance measures for information retrieval systems

被引:0
作者
Meng, Xiannong [1 ]
机构
[1] Bucknell Univ, Dept Comp Sci, Lewisburg, PA 17837 USA
来源
Third International Conference on Information Technology: New Generations, Proceedings | 2006年
关键词
information retrieval; performance measurement; Web search; user studies; user preference;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional performance measures of information retrieval systems include precision and recall and their variants. While these measures work well in closed-laboratory environments, they are not suitable for practical IR systems such as Web search systems. Many single-value measures were proposed to improve over the precision-recall measure, such as expected search length (ESL), average search length (ASL) and RankPower. We compare in this paper the measures of ESL, ASL, and RankPower applied to a set of real Web retrieval data. The results demonstrate that RankPower indeed is a feasible, effective, and easy-to-use single-value measure for performance of practical IR systems such as Web search engines.
引用
收藏
页码:578 / 579
页数:2
相关论文
共 5 条
[1]  
CHEN Z, 2002, P INT C INT COMP JUL, P643
[2]  
Cooper W.S., 1968, J AM SOC INFORM SCI, V19, P30
[3]  
KORFHAGE RR, 1997, INFORMATION STORAGE
[4]  
LOSEE RM, 1998, TEXT RETRIEVAL FILTE
[5]  
Meng XN, 2005, WEB MINING: APPLICATIONS AND TECHNIQUES, P99