Total, Between-, and Within-Item Attribute Person Fit Analysis Using Mokken Scaling Techniques: An Exploratory Nonparametric Approach to Person Fit

The purpose of this study was to consider how researchers can incorporate item attributes into nonparametric person fit analysis for the purpose of providing additional insight into person fit beyond what is available using typical total-scale person fit approaches. Inspired by parametric person fit statistics that consider patterns of residuals at the total-scale, between-item-attribute, and within-item-attribute levels, we proposed simple adaptations to standard Mokken Scale Analysis (MSA) person fit analysis techniques to reflect these three levels of person fit analysis. We demonstrated the technique using a secondary analysis of survey data related to learning motivation and considered how the results may be interpreted in an affective assessment context. We used a simple exploratory simulation study to consider the techniques under a wider range of conditions. Overall, the results suggested that it is possible to incorporate item attributes into MSA person fit analysis at the total-scale, between-item-attribute, and within-item attribute levels, and that each set of analyses provides a unique perspective on person fit.