Implicit user behaviours to improve post-retrieval document relevancy

被引:11
作者
Balakrishnan, Vimala [1 ]
Zhang, Xinyue [1 ]
机构
[1] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
关键词
Document relevancy; Text selection; Page review; Dwell time; Click-through; WEB SEARCH; FEEDBACK; SYSTEMS;
D O I
10.1016/j.chb.2014.01.001
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The collection of user feedback as indications of users' interests resulted in a growing interest in improving users' search experiences. In this article, we describe a method that integrates multiple implicit feedback approaches to unobtrusively monitor users' interactions to improve document search results relevancy. The study gathered users' feedback based on the dwell time, click-through data, page review, and also text selection. An experiment was conducted to assess the performance of the proposed integrated model. Collected data were analysed and compared at three ranking levels, that is, top 10, 15 and 25. Both the mean average precisions and normalised discounted cumulative gain values indicate the integrated model to significantly outperform the baseline (TF-IDF) at each of the varying levels. Moreover, a comparison across all the models also show the integrated model to have the best search performance further indicating that merging multiple feedback techniques improves the overall document relevancy. Results also show page review and text selection have the lowest and highest precisions, respectively among all the four implicit feedback models, however the differences are insignificant. Overall it can be concluded that integrated implicit feedback significantly improves post-retrieval document relevancy compared to stand-alone feedback, and also when no feedback is available. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 112
页数:9
相关论文
共 32 条
[11]  
Jarvelin K, 2000, P 23 ANN INT ACM SIG, P41, DOI DOI 10.1145/345508.345545
[12]   Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search [J].
Joachims, Thorsten ;
Granka, Laura ;
Pan, Bing ;
Hembrooke, Helene ;
Radlinski, Filip ;
Gay, Geri .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2007, 25 (02)
[13]   Click data as implicit relevance feedback in web search [J].
Jung, Seikyung ;
Herlocker, Jonathan L. ;
Webster, Janet .
INFORMATION PROCESSING & MANAGEMENT, 2007, 43 (03) :791-807
[14]  
Kelly Diane, 2009, Foundations and Trends in Information Retrieval, V3, P1, DOI 10.1561/1500000012
[15]  
Liu N.N., 2010, P 19 ACM INT C INF K, P1445
[16]   How do users describe their information need: Query recommendation based on snippet click model [J].
Liu, Yiqun ;
Miao, Junwei ;
Zhang, Min ;
Ma, Shaoping ;
Ru, Liyun .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (11) :13847-13856
[17]  
Liu Z., 2008, P 17 INT C WORLD WID, P1049, DOI DOI 10.1145/1367497.1367650
[18]  
Morita M., 1994, P 17 ANN INT ACM SIG, P272
[19]  
Morris D, 2008, CHI 2008: 26TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS VOLS 1 AND 2, CONFERENCE PROCEEDINGS, P1207
[20]   An Adaptive Match-Making System reflecting the explicit and implicit preferences of users [J].
Park, Yoon-Joo .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (04) :1196-1204