Integrating heuristics and think-aloud approach to evaluate the usability of game-based learning material

被引:10
作者
Chang, Chi-Cheng [1 ]
Johnson, Tristan [2 ]
机构
[1] Natl Taiwan Normal Univ, Dept Technol Applicat & Human Resource Dev, Taipei, Taiwan
[2] Northeastern Univ, Grad Sch Engn, Engn Educ Initiat, Boston, MA 02115 USA
关键词
Game-based learning; Heuristics; Think-aloud; Usability; Energy saving; EDUCATIONAL GAMES; DESIGN; INFORMATION; DICTIONARY; SIMULATION; PRODUCT;
D O I
10.1007/s40692-020-00174-5
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The purpose of this study was to evaluate the usability of a game-based learning material. The heuristics and think-aloud approach were employed to determine the usability of the learning material. Four experts used the learning material independently and completed a heuristic evaluation questionnaire based on a design and use perspective. Forty-five university students used the learning material independently and completed a heuristic evaluation questionnaire based on their experiences. The heuristic evaluation questionnaire was comprised of six constructs with a total of twelve heuristic evaluation criteria. The experts and students provided data about usability problems while using the learning material. The usability problems that were found included: (a) inconsistent interface styles on different learning units (i.e., game scenes) that affected the learnability, memorability and operation of interfaces; (b) inadequate operational efficiency and guidance could be improved; (c) small games and instructional videos could probably increase learning times and loads; (d) different guidance and supports for errors and inconsistent display styles of error messages for each learning units; and (e) inappropriate feedback on errors and inadequate interaction on instructional videos. The usability problems were identified and improved with the usability evaluation methods. Educational implication and research recommendation are discussed.
引用
收藏
页码:137 / 157
页数:21
相关论文
共 50 条
[1]   Applying student-generated theories about global change and energy demand [J].
Ahamer, Gilbert .
INTERNATIONAL JOURNAL OF INFORMATION AND LEARNING TECHNOLOGY, 2015, 32 (05) :258-271
[2]   Simulation and gaming to promote health education: Results of a usability test [J].
Albu, Mihai ;
Atack, Lynda ;
Srivastava, Ishaan .
HEALTH EDUCATION JOURNAL, 2015, 74 (02) :244-254
[3]  
[Anonymous], 2014, P 22 INT C COMP ED
[4]   Measure of the Lived and Functional Effects of Gamification: An Experimental Study in a Professional Context [J].
Brangier, Eric ;
Marache-Francisco, Cathie .
ADVANCES IN ERGONOMICS IN DESIGN, 2020, 955 :242-253
[5]   Development and usability evaluation of the mHealth Tool for Lung Cancer (mHealth TLC): A virtual world health game for lung cancer patients [J].
Brown-Johnson, Cati G. ;
Berrean, Beth ;
Cataldo, Janine K. .
PATIENT EDUCATION AND COUNSELING, 2015, 98 (04) :506-511
[6]   Usability testing for e-learning material for new employee training: A design-based research approach [J].
Chang, Chiungsui .
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2011, 42 (06) :E125-E130
[7]   Effects of Educational Role-Playing and Simulation Games: Designing Interactive Carbon Footprint Curriculum for Primary School Students [J].
Chen, Ming-Hsiu Mia ;
Tsai, Shih-Ting ;
Chang, Chi-Cheng .
JOURNAL OF RESEARCH IN EDUCATION SCIENCES, 2016, 61 (04) :1-32
[8]   The Electronic Dictionary for Writing: A Solution or a Problem [J].
Chon, Y. V. .
INTERNATIONAL JOURNAL OF LEXICOGRAPHY, 2009, 22 (01) :23-54
[9]   Reflecting on the think-aloud method for evaluating e-learning [J].
Cotton, D ;
Gresty, K .
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2006, 37 (01) :45-54
[10]   Design and evaluation of a computer game for the learning of Information and Communication Technologies (ICT) concepts by physical education and sport science students [J].
Couceiro, Rosana Margarida ;
Papastergiou, Marina ;
Kordaki, Maria ;
Veloso, Ana Isabel .
EDUCATION AND INFORMATION TECHNOLOGIES, 2013, 18 (03) :531-554