Analytic review of usability evaluation in ISMAR

被引:31
作者
Bai, Zhen [1 ]
Blackwell, Alan F. [1 ]
机构
[1] Univ Cambridge, Comp Lab, Cambridge CB3 0FD, England
关键词
Augmented Reality; Usability evaluation; User experience; Collaboration; HEAD MOUNTED DISPLAY; AUGMENTED REALITY; GRAPHICAL CONTEXT; USER; PERCEPTION; TRACKING; DESIGN;
D O I
10.1016/j.intcom.2012.07.004
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
There has been a rapid increase in research evaluating usability of Augmented Reality (AR) systems in recent years. Although many different styles of evaluation are used, there is no clear consensus on the most relevant approaches. We report a review of papers published in International Symposium of Mixed and Augmented Reality (ISMAR) proceedings in the past decade, building on the previous work of Swan and Gabbard (2005). Firstly, we investigate the evaluation goal, measurement and method of ISMAR papers according to their usability research in four categories: performance, perception and cognition, collaboration and User Experience (UX). Secondly, we consider the balance of evaluation approaches with regard to empirical-analytical, quantitative-qualitative and participant demographics. Finally we identify potential emphases for usability study of AR systems in the future. These analyses provide a reference point for current evaluation techniques, trends and challenges, which benefit researchers intending to design, conduct and interpret usability evaluations for future AR systems. (C) 2012 British Informatics Society Limited. All rights reserved.
引用
收藏
页码:450 / 460
页数:11
相关论文
共 90 条
[1]  
ANABUKI M, 2007, P 6 IEEE ACM INT S M, P55
[2]  
[Anonymous], 2008, 92412102008 ISO DIS
[3]  
Avery B, 2008, INT SYM MIX AUGMENT, P69, DOI 10.1109/ISMAR.2008.4637327
[4]   Evaluating label placement for augmented reality view management [J].
Azuma, R ;
Furmanski, C .
SECOND IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, 2003, :66-75
[5]   A survey of augmented reality [J].
Azuma, RT .
PRESENCE-VIRTUAL AND AUGMENTED REALITY, 1997, 6 (04) :355-385
[6]  
Bach C., 2004, P IUI CADUI WORKSH E
[7]   Dynamic shader lamps : Painting on movable objects [J].
Bandyopadhyay, D ;
Raskar, R ;
Fuchs, H .
IEEE AND ACM INTERNATIONAL SYMPOSIUM ON AUGMENTED REALITY, PROCEEDINGS, 2001, :207-216
[8]  
Barkhuus L., 2007, P CHI 2007 SAN JOS U, V28
[9]   Using augmented reality for visualizing complex graphs in three dimensions [J].
Belcher, D ;
Billinghurst, M ;
Hayes, SE ;
Stiles, R .
SECOND IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, 2003, :84-92
[10]   Collaborative mixed reality visualization of an archaeological excavation [J].
Benko, H ;
Ishak, EW ;
Feiner, S .
ISMAR 2004: THIRD IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, 2004, :132-140