SimTrA (Simulation Trace Analyzer): The analysis of cognitive user model for the evaluation of human-machine systems

In this paper the question is raised, in what way cognitive model data can be analyzed and used to evaluate human-machine systems in early design stages. The focus is directed to eye movement data simulated by cognitive user models in ACT-R (Atomic Components of Thought - Rational) and human eye movement data. To process both the cognitive model data and the empirical data and to compare the outcomes in an effective and efficient manner the tool SimTrA (Simulation Trace Analyzer) was developed. The tool provides a repertoire of methods to evaluate human-machine interfaces in a formal and computerized way based on cognitive model data. The results of an evaluation study validate that cognitive user models in general can be applied in early stages of the development process of human-machine interfaces and under certain conditions provide statements comparable with empirical data. The study further indicates that the analysis of simulated eye movement data with SimTrA is possible and supports the evaluation of human-machine systems. Hence SimTrA is a useful tool for cognitive modeling and for prototype evaluation in early design phases of human-machine systems.