Construction of the Teacher Situational Judgment Test

被引:6
作者
Chao, Tzu-Yang [1 ]
Huang, Jia-Li [2 ]
Sung, Yao-Ting [1 ]
Kuo, Hui-Ning [3 ]
Shiu, Ming-Huei [3 ]
机构
[1] Natl Taiwan Normal Univ, Dept Educ Psychol & Counseling, Taipei, Taiwan
[2] Natl Taiwan Normal Univ, Off Teacher Educ & Careers Serv, Taipei, Taiwan
[3] Natl Taiwan Normal Univ, Res Ctr Psychol & Educ Testing, Taipei, Taiwan
来源
JOURNAL OF RESEARCH IN EDUCATION SCIENCES | 2016年 / 61卷 / 02期
关键词
reliability; validity; teacher situational judgment test; item response theory; qualitative analysis;
D O I
10.6209/JORIES.2016.61(2).04
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student's thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded .7. Additionally, the Rasch model analysis showed that 90.67% of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between .47 and .74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.
引用
收藏
页码:85 / 117
页数:33
相关论文
共 55 条
[21]  
Hwang YR, 2009, J RES EDUC SCI, V54, P171
[22]  
Kennedy MM, 2006, EDUC LEADERSHIP, V63, P14
[23]  
Koster B., 2008, TEACH TEACH, V14, P567, DOI DOI 10.1080/13540600802571411
[24]   On the nature of teaching and teacher education - Difficult practices that look easy [J].
Labaree, DF .
JOURNAL OF TEACHER EDUCATION, 2000, 51 (03) :228-233
[25]  
Lai B.-C., 2003, LAIS PERSONALITY INV
[26]  
Layne H. B., 1997, RES REFLECTIONS, V3, P17
[27]   Situational judgment tests: a review of recent research [J].
Lievens, Filip ;
Peeters, Helga ;
Schollaert, Eveline .
PERSONNEL REVIEW, 2008, 37 (04) :426-441
[28]   Video-based versus written situational judgment tests: A comparison in terms of predictive validity [J].
Lievens, Filip ;
Sackett, Paul R. .
JOURNAL OF APPLIED PSYCHOLOGY, 2006, 91 (05) :1181-1188
[29]   The Effects of Response Instructions on Situational Judgment Test Performance and Validity in a High-Stakes Context [J].
Lievens, Filip ;
Sackett, Paul R. ;
Buyse, Tine .
JOURNAL OF APPLIED PSYCHOLOGY, 2009, 94 (04) :1095-1101
[30]   A RASCH MODEL FOR PARTIAL CREDIT SCORING [J].
MASTERS, GN .
PSYCHOMETRIKA, 1982, 47 (02) :149-174