Application of a new computerized adaptive testing technique to estimation of CM personnel professional skills

被引:0
作者
Kuravsky, Lev S. [1 ]
Yuryev, Grigory A. [1 ]
机构
[1] Moscow State Univ Psychol & Educ, 29 Sretenka St, Moscow 127051, Russia
来源
8TH INTERNATIONAL CONFERENCE ON CONDITION MONITORING AND MACHINERY FAILURE PREVENTION TECHNOLOGIES 2011, VOLS 1 AND 2 | 2011年
基金
俄罗斯基础研究基金会;
关键词
Adaptive testing; Markov models; Markov model identification; Item Response Theory; Classical Test Theory;
D O I
暂无
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Computerized testing is widely used for diagnostics and estimation of professional skills including education quality control. Both quality of testing and reliability of its results depend on a selected test technology that was a scientific research object during last years. Initially specialists applied the classical theory borrowed from physics for test design basing on the suggestion that measured characteristics have true mean distorted by some system errors. This approach was widely used but it had many disadvantages. In 1960 G. Rash proposed the new one-parametric model for optimal test design, according to which probability of the right answer to a test question depends on the distance between person skill level and the difficulty of introduced test tasks. Some problems of such models are: - Ignoring the fact that the person tired of the testing process could cause essential changes in test results - Time spent on solving tasks has no influence on skill estimation - A subject needs to solve rather great number of test tasks to get sufficient accuracy of skill estimation Difficulty of calculating probability distributions of possible test results that is necessary for evaluating their reliability - The employed procedure of result accuracy estimation with the aid of the maximum likelihood method is comparatively difficult for practical implementation. These problems inspired creation of the adaptive testing technology under consideration, which is based on application of trained structures in the form of discrete-and continuous-time Markov models. Its peculiarities, in particular, are revealing and using test solution capability changes in quantitative evaluation of their time-domain dynamics as well as taking into account timetable of testing process. The approach suggested has certain advantages over the testing techniques, which were used before, owing to its greater information capability and acceleration of a test procedure.
引用
收藏
页码:342 / 351
页数:10
相关论文
共 18 条
  • [1] [Anonymous], 1999, Mathematical Methods of Statistics
  • [2] [Anonymous], 1980, PROBABILISTIC MODELS
  • [3] [Anonymous], 1999, Measurement essentials
  • [4] Avanesov V.S., 2003, PEDAGOGICHESKAYA DIA, P69
  • [5] Baker F., 2001, BASICS ITEM RESPONSE
  • [6] Gregory R.J., 2007, PSYCHOL TESTING HIST, V5th
  • [7] Gulliksen H., 1950, THEORY MENTAL TESTS
  • [8] Haberman ShelbyJ., 1988, ANAL QUALITATIVE DAT
  • [9] Kardanova E.Yu., 2008, TEST MODELING PARAME
  • [10] Kuravsky L.S., 2001, APPL NEURAL NETWORKS, P47