Relevance Criteria for E-Commerce: A Crowdsourcing-based Experimental Analysis

被引:11
作者
Alonso, Omar [1 ]
Mizzaro, Stefano [1 ]
机构
[1] A9 Com, Palo Alto, CA USA
来源
PROCEEDINGS 32ND ANNUAL INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL | 2009年
关键词
IR evaluation; relevance; relevance criteria; user study; OF-THE-LITERATURE; INFORMATION-SCIENCE; FRAMEWORK; THINKING; NOTION;
D O I
10.1145/1571941.1572115
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We discuss the concept of relevance criteria in the context of e-Commerce search. A vast body of research literature describes the beyond-topical criteria used to determine the relevance of the document to the need. We argue that in an e-Commerce scenario there are some differences, and novel and different criteria can be used to determine relevance. We experimentally validate this hypothesis by means of Amazon Mechanical Turk using a crowdsourcing approach.
引用
收藏
页码:760 / 761
页数:2
相关论文
共 7 条
[1]  
Alonso Omar, 2008, SIGIR Forum, V42, P9, DOI 10.1145/1480506.1480508
[2]   Users' criteria for relevance evaluation: A cross-situational comparison [J].
Barry, CL ;
Schamber, L .
INFORMATION PROCESSING & MANAGEMENT, 1998, 34 (2-3) :219-236
[3]  
Kittur A, 2008, CHI 2008: 26TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS VOLS 1 AND 2, CONFERENCE PROCEEDINGS, P453
[4]  
Mizzaro S, 1997, J AM SOC INFORM SCI, V48, P810, DOI 10.1002/(SICI)1097-4571(199709)48:9<810::AID-ASI6>3.0.CO
[5]  
2-U
[6]   Relevance: A Review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance [J].
Saracevic, Tefko .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (13) :2126-2144
[7]   Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: Nature and manifestations of relevance [J].
Saracevic, Tefko .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (13) :1915-1933