Examining the generalizability of the User Engagement Scale (UES) in exploratory search

被引:112
作者
O'Brien, Heather L. [1 ]
Toms, Elaine G. [2 ]
机构
[1] Univ British Columbia, iSch, Vancouver, BC V5Z 1M9, Canada
[2] Univ Sheffield, Sch Informat, Sheffield S1 4DP, S Yorkshire, England
基金
加拿大创新基金会;
关键词
Interactive information retrieval; Exploratory search; Evaluation; User Engagement Scale; User experience; SYSTEMS; MODEL; FLOW;
D O I
10.1016/j.ipm.2012.08.005
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The user experience is an integral component of interactive information retrieval (IIR). However, there is a twofold problem in its measurement. Firstly, while many IIR studies have relied on a single dimension of user feedback, that of satisfaction, experience is a much more complex concept. IIR in general, and exploratory search more specifically, are dynamic, multifaceted experiences that evoke pragmatic and hedonic needs, expectations, and outcomes that are not adequately captured by user satisfaction. Secondly, questionnaires, which are typically the means in which user's attitudes and perceptions are measured, are not typically subjected to rigorous reliability and validity testing. To address these issues, we administered the multidimensional User Engagement Scale (UES) in an exploratory search environment to assess users' perceptions of the Perceived Usability (PUs), Aesthetics (AE), Novelty (NO), Felt Involvement (FI), Focused Attention (FA), and Endurability (EN) aspects of the experience. In a typical laboratory-style study, 381 participants performed three relatively complex search tasks using a novel search interface, and responded to the UES immediately upon completion. We used Principal Axis Factor Analysis and Multiple Regression to examine the factor structure of UES items and the relationships amongst factors. Results showed that three of the six sub-scales (PUs, AE, FA) were stable, while NO, FI and EN merged to form a single factor. We discuss recommendations for revising and validating the UES in light of these findings. (c) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1092 / 1107
页数:16
相关论文
共 50 条
[1]   The effect of user characteristics on search effectiveness in information retrieval [J].
Al-Maskari, Azzah ;
Sanderson, Mark .
INFORMATION PROCESSING & MANAGEMENT, 2011, 47 (05) :719-729
[2]   A Review of Factors Influencing User Satisfaction in Information Retrieval [J].
Al-Maskari, Azzah ;
Sanderson, Mark .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2010, 61 (05) :859-868
[3]   Developing and validating an instrument for measuring user-perceived web quality [J].
Aladwani, AM ;
Palvia, PC .
INFORMATION & MANAGEMENT, 2002, 39 (06) :467-476
[4]  
[Anonymous], 2008, 9241210 ISO DIS
[5]  
[Anonymous], 2000, CONSTRUCTING EFFECTI
[6]  
[Anonymous], 2003, SCALE DEV THEORY APP
[7]  
Banhawi F., 2011, 2011 International Conference on Semantic Technology and Information Retrieval (STAIR 2011), P297, DOI 10.1109/STAIR.2011.5995805
[8]  
Borlund P, 2003, INFORM RES, V8
[9]  
Csikszentmthalyi M., 1990, FLOW PSYCHOL OPTIMAL
[10]   The DeLone and McLean model of information systems success: a ten-year update [J].
DeLone, WH ;
McLean, ER .
JOURNAL OF MANAGEMENT INFORMATION SYSTEMS, 2003, 19 (04) :9-30