Implicit user behaviours to improve post-retrieval document relevancy

被引:11
作者
Balakrishnan, Vimala [1 ]
Zhang, Xinyue [1 ]
机构
[1] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
关键词
Document relevancy; Text selection; Page review; Dwell time; Click-through; WEB SEARCH; FEEDBACK; SYSTEMS;
D O I
10.1016/j.chb.2014.01.001
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The collection of user feedback as indications of users' interests resulted in a growing interest in improving users' search experiences. In this article, we describe a method that integrates multiple implicit feedback approaches to unobtrusively monitor users' interactions to improve document search results relevancy. The study gathered users' feedback based on the dwell time, click-through data, page review, and also text selection. An experiment was conducted to assess the performance of the proposed integrated model. Collected data were analysed and compared at three ranking levels, that is, top 10, 15 and 25. Both the mean average precisions and normalised discounted cumulative gain values indicate the integrated model to significantly outperform the baseline (TF-IDF) at each of the varying levels. Moreover, a comparison across all the models also show the integrated model to have the best search performance further indicating that merging multiple feedback techniques improves the overall document relevancy. Results also show page review and text selection have the lowest and highest precisions, respectively among all the four implicit feedback models, however the differences are insignificant. Overall it can be concluded that integrated implicit feedback significantly improves post-retrieval document relevancy compared to stand-alone feedback, and also when no feedback is available. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 112
页数:9
相关论文
共 32 条
[1]  
Agichtein E., 2006, Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P19, DOI 10.1145/1148170.1148177
[2]  
Ahn J.wook., 2008, PROCEEDING 17 INT C, P1, DOI DOI 10.1145/1367497.1367499
[3]  
Baeza-Yates R, 1999, MODERN INFORM RETRIE, V463
[4]   Post-retrieval search hit clustering to improve information retrieval effectiveness: Two digital forensics case studies [J].
Beebe, Nicole Lang ;
Clark, Jan Guynes ;
Dietrich, Glenn B. ;
Ko, Myung S. ;
Ko, Daijin .
DECISION SUPPORT SYSTEMS, 2011, 51 (04) :732-744
[5]   A3CRank: An adaptive ranking method based on connectivity, content and click-through data [J].
Bidoki, Ali Mohammad Zareh ;
Ghodsnia, Pedram ;
Yazdani, Nasser ;
Oroumchian, Farhad .
INFORMATION PROCESSING & MANAGEMENT, 2010, 46 (02) :159-169
[6]  
Buscher Georg., 2012, WSDM, P373, DOI [10.1145/2124295.2124341, DOI 10.1145/2124295.2124341]
[7]   Inferring user interest [J].
Claypool, M ;
Brown, D ;
Le, P ;
Waseda, M .
IEEE INTERNET COMPUTING, 2001, 5 (06) :32-39
[8]  
DOU Z, 2008, P 17 ACM C INF KNOWL, P73, DOI DOI 10.1145/1458082.1458095
[9]   Evaluating implicit measures to improve web search [J].
Fox, S ;
Karnawat, K ;
Mydland, M ;
Dumais, S ;
White, T .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2005, 23 (02) :147-168
[10]  
Guo Q., 2012, PROC 21 INT C WORLD, P569, DOI 10.1145/2187836.2187914