Global and Large-Scale Pre-School Digital Games Based Learning Evaluation

Many game editors are proposing web applications with more than 200-300 Digital Games Based Learning (DGBL) for pre-school children. There added values are to propose advises in the choice of games by the way of a recommending system, a personalizing system, or just to propose a large variety of activities. They are going bigger and evolve when designer bought set of games to publisher. The strategic choice of publishers or the type of games is sometimes difficult because designer didn't have a global view of their corpus of games or on the uses the learners do. Our work consists in proposing to them a protocol to gather data and a dashboard tool to analyze them in order have this global view and make good decisions. A focus is made on indicators construction and metrics used. The observation methods used to collect data are heuristic analyses, structured observations of child-DGBL interactions, log tracks, survey and diaries (for parent, teacher and child opinions) and video. The DGBL analyzing tool is composed of three parts: a data capture interface, a study endpoint configuration interface (used to specify the wished level of quality) and a dashboard for analysis and decision-making. These protocol and tool are so usable to made formative or summative global and large-scale evaluation. "Global" means that evaluations take into account various criteria like usability, game play and immersion, pedagogical performance and context of use. "Large-scale" mean that they can be use on many users and on many games.