Evaluation Methods for Intelligent Tutoring Systems Revisited

The 1993 paper in IJAIED on evaluation methods for Intelligent Tutoring Systems (ITS) still holds up well today. Basic evaluation techniques described in that paper remain in use. Approaches such as kappa scores, simulated learners and learning curves are refinements on past evaluation techniques. New approaches have also arisen, in part because of increases in the speed, storage capacity and connectivity of computers over the past 20 years. This has made possible techniques in crowd sourcing, propensity-score matching, educational data mining and learning analytics. This short paper outlines some of these approaches.