Impact of Cross-Calibration Methods on the Interpretation of a Treatment Comparison Study Using 2 Depression Scales

被引:7
作者
Fischer, Herbert Felix [1 ,2 ]
Wahl, Inka [3 ,4 ]
Fliege, Herbert [3 ,4 ]
Klapp, Burghard F. [2 ]
Rose, Matthias [3 ,4 ]
机构
[1] Charite Univ Med Ctr, Inst Social Med Epidemiol & Hlth Econ, D-10117 Berlin, Germany
[2] Charite Univ Med Ctr, Dept Psychosomat Med & Psychotherapy, Clin Internal Med, D-10117 Berlin, Germany
[3] Univ Med Ctr Hamburg Eppendorf, Dept Psychosomat Med & Psychotherapy, Hamburg, Germany
[4] Schon Klin Hamburg Eilbek, Hamburg, Germany
关键词
item response theory; psychometrics; comparability of measures; depression self-rating scales; equating; ITEM RESPONSE THEORY; ICD-10-SYMPTOM-RATING ISR; VALIDITY; MODEL;
D O I
10.1097/MLR.0b013e31822945b4
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background: Many questionnaires assessing depressive symptoms are available. Most of these questionnaires are constructed based on classical test theory, making comparisons of individual scores difficult. Item response theory (IRT) allows the comparison of scores from different instruments. In this study, the impact of IRT-based cross-calibration methods on the results of a treatment outcome study was evaluated using 2 instruments. Methods: Data collected during admission and discharge procedures from 1066 inpatients in 2 psychosomatic clinics using different depression measures were analyzed. To achieve comparability across the applied depression measures, we used an IRT-based conversion table to transform scores from one instrument's scale to the other. Latent trait values were also estimated using different instruments in each clinic. We compared these methods to the traditional approach of using the same instrument in both clinics and examined their effects on the statistical analyses. Results: There was no substantial change in the interpretation of the study results when different instruments were used. However, F values, P values, and effect sizes in the analysis of variance changed significantly. This might be attributed to differences in the content or measurement properties of the instruments. Interestingly, no difference was observed between use of transformed sum scores and latent trait values. Conclusions: IRT cross-calibration methods are a convenient way to enhance the comparability of questionnaire data in applied clinical settings but seem not to be able to overcome differences in measurement properties of the instruments. As these differences can lead to biased results, there is a need for further research into more advanced techniques.
引用
收藏
页码:320 / 326
页数:7
相关论文
共 36 条
[21]  
Kizilhan JI, PSYCHOMETRI IN PRESS
[22]   The PHQ-9 - Validity of a brief depression severity measure [J].
Kroenke, K ;
Spitzer, RL ;
Williams, JBW .
JOURNAL OF GENERAL INTERNAL MEDICINE, 2001, 16 (09) :606-613
[23]   Monitoring depression treatment outcomes with the patient health questionnaire-9 [J].
Löwe, B ;
Unützer, J ;
Callahan, CM ;
Perkins, AJ ;
Kroenke, K .
MEDICAL CARE, 2004, 42 (12) :1194-1201
[24]   Diagnosing ICD-10 depressive episodes:: Superior criterion validity of the patient health questionnaire [J].
Löwe, B ;
Gräfe, K ;
Zipfel, S ;
Witte, S ;
Loerch, B ;
Herzog, W .
PSYCHOTHERAPY AND PSYCHOSOMATICS, 2004, 73 (06) :386-390
[25]   Measuring depression outcome with a brief self-report instrument:: sensitivity to change of the Patient Health Questionnaire (PHQ-9) [J].
Löwe, B ;
Kroenke, K ;
Herzog, W ;
Gräfe, K .
JOURNAL OF AFFECTIVE DISORDERS, 2004, 81 (01) :61-66
[26]   A Monte Carlo comparison of item and person statistics based on item response theory versus classical test theory [J].
MacDonald, P ;
Paunonen, SV .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2002, 62 (06) :921-943
[27]  
Pournelle G. H., 1953, Journal of Mammalogy, V34, P133, DOI 10.1890/0012-9658(2002)083[1421:SDEOLC]2.0.CO
[28]  
2
[29]   Item Response Theory and Clinical Measurement [J].
Reise, Steven P. ;
Waller, Niels G. .
ANNUAL REVIEW OF CLINICAL PSYCHOLOGY, 2009, 5 :27-48
[30]  
Rizopoulos D, 2006, J STAT SOFTW, V17