Multivariate Structural Analysis of Agreement for Categorical Data

被引：0
作者：
Fumiaki Kiyomi
机构：
[1] Chuo University,Graduate School of Science and Engineering
[2] Novo Nordisk Pharma Ltd.,Statistics Section, Clinical Statistics Department
来源：
Behaviormetrika | 2003年 / 30卷 / 2期
关键词：
agreement; multivariate; reliability; categorical data; measurement error model; kappa; maximum likelihood;
D O I：
10.2333/bhmk.30.195
中图分类号：
学科分类号：
摘要：
A statistical model is proposed for a multi-dimensional agreement matrix tabulating nominal variables and judgments of two raters in order to analyze the structure of agreement. The model is derived from the notion of the measurement error model in test theory, and it is expressed as a tree with a single divergence. The model is composed of probabilities of agreement, a true score and errors of raters as parameters. It is shown that the parameters can be estimated by the usual maximum likelihood approach and the agreement probabilities are reliability measures. The model is extended to apply to cases of more than three variables and three raters. Partial modifications to the model are discussed for ordered categorical variables and the consistency matrix generated by two sets of answers to a questionnaire. An application example is presented for the consistency matrix.
引用
收藏
页码：195 / 218
页数：23
相关论文
共 35 条
  • [1] Boyd NF(1982)Observer variation in the interpretation of xeromammograms Journal of the National Cancer Institute 68 357-363
  • [2] Wolfson C(1971)A new procedure for assessing reliability of scoring EEG sleep recordings American Journal of EEG Technology 11 101-109
  • [3] Moskowitz M(1960)Weighted Kappa: Nominal scale agreement with provision for scaled disagreement or partial credit Educational and Psychological Measurement 20 37-46
  • [4] Carlile T(1968)Reliability and expected loss: A unifying principle Psychological Bulletin 70 213-220
  • [5] Petitclerc M(1994)The equivalence of weighted Kappa and the intraclass correlation coefficient as measures of reliability Psychometrika 59 203-216
  • [6] Ferri HA(1973)Large sample standard errors of kappa and weighted kappa Educational and Psychological Measurement 33 613-619
  • [7] Fishell E(1969)Reliability and validity of a rating scale for post-stroke psychiatric symptoms Psychological Bulletin 72 323-327
  • [8] Gregoire A(1999)The statistical analysis of general processing tree models with the EM algorithm Alzheimer Disease and Associated Disorders 13 148-158
  • [9] Kiernan M(1994)Development of insulin therapy related quality of life measure (ITR-QOL) Psychometrika 59 21-47
  • [10] Longley JD(2001)Structural analysis of subjective categorical data Tonyobyo 44 9-15
1234