Using Eye-Tracking and Emotion Recognition as Additional Sources of Information When Testing People with Intellectual Disabilities

Today, the development of special-purpose software for helping People with Intellectual Disabilities (PID) in their daily life and professional activities is a very active trend. Various testing systems with simplified text, images or videos are used to analyze problems, interests, and preferences of the PID related to their daily life or professional activities. However, in relation to the PID, the credibility of the test results might strongly depend on how much they understand the testing process and how they interpret questions and choose the answers. This article discusses the possibility of increasing the reliability of the PID test results by adding additional sources of information. A web-based system is described for analyzing professional interests and preferences of PID using additional data on the point of gaze and emotional state of PID during the testing process. A method for evaluating test results is described, taking into account the contribution of these data as well as possible errors occurred when collecting them. The results of testing with the participation of several PIDs are presented, and it is shown that adding such sources of information as eye tracking data and emotion analysis can increase the reliability of the test results.