Effects of item type and estimation method on the accuracy of estimated personality trait scores: Polytomous item response theory models versus summated scoring

被引:6
作者
Speer, Andrew B. [1 ,3 ]
Robie, Chet [2 ]
Christiansen, Neil D. [3 ]
机构
[1] Amer Family Insurance, 6000 Amer Pkwy, Madison, WI 53704 USA
[2] Wilfrid Laurier Univ, Lazaridis Sch Business & Econ, Waterloo, ON N2L 3C5, Canada
[3] Cent Michigan Univ, Dept Psychol, Mt Pleasant, MI 48859 USA
关键词
Item response theory; Classical test theory; Personality trait estimates; IDEAL POINT; IRT; ASSUMPTIONS; VALIDITY; SCALES;
D O I
10.1016/j.paid.2016.06.058
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Despite an increased use in item response theory (IRT)-based personality testing there is little research documenting whether trait estimations are actually improved over those derived via simply summated scoring according to classical test theory (CTT). In this study personality scale validity was compared using a variety of estimation methods (CTT, adjusted-CTT, SGR, GGUM) and item types (monotonic vs. non-monotonic) for the traits of conscientiousness and extraversion. Regardless of item type or estimation method, trait estimates were highly correlated. Using job performance ratings as an external criterion within the nomological network of these traits, model fit was not related to scale validity, and all estimation procedures resulted in comparable validity coefficients. Implications are discussed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:41 / 45
页数:5
相关论文
共 16 条
[1]   THE BIG 5 PERSONALITY DIMENSIONS AND JOB-PERFORMANCE - A METAANALYSIS [J].
BARRICK, MR ;
MOUNT, MK .
PERSONNEL PSYCHOLOGY, 1991, 44 (01) :1-26
[2]  
Broadfoot A. A., 2008, DISS ABSTR INT B
[3]   How IRT Can Solve Problems of Ipsative Data in Forced-Choice Questionnaires [J].
Brown, Anna ;
Maydeu-Olivares, Alberto .
PSYCHOLOGICAL METHODS, 2013, 18 (01) :36-52
[4]   Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures [J].
Chernyshenko, Oleksandr S. ;
Stark, Stephen ;
Drasgow, Fritz ;
Roberts, Brent W. .
PSYCHOLOGICAL ASSESSMENT, 2007, 19 (01) :88-106
[5]   Consequences of Ignoring Ideal Point Items for Applied Decisions and Criterion-Related Validity Estimates [J].
Dalal, Dev K. ;
Carter, Nathan T. .
JOURNAL OF BUSINESS AND PSYCHOLOGY, 2015, 30 (03) :483-498
[6]   Fitting polytomous item response theory models to multiple-choice tests [J].
Drasgow, F ;
Levine, MV ;
Tsien, S ;
Williams, B ;
Mead, AD .
APPLIED PSYCHOLOGICAL MEASUREMENT, 1995, 19 (02) :143-165
[7]   Item response theory and classical test theory: An empirical comparison of their item/person statistics [J].
Fan, XT .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1998, 58 (03) :357-381
[8]  
Ferrando PJ, 2007, PSICOLOGICA, V28, P237
[9]  
Hambleton, 2001, ITEM RESPONSE THEORY
[10]  
Kosinski M., 2009, THESIS