Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines

被引：2078

作者：

O'Connor, Cliodhna ^{[1
]}

Joffe, Helene ^{[2
]}

机构：

[1] Univ Coll Dublin, Sch Psychol, Dublin 4, Ireland

[2] UCL, Div Psychol & Language Sci, London, England

来源：

INTERNATIONAL JOURNAL OF QUALITATIVE METHODS | 2020年 / 19卷

基金：

欧盟地平线“2020”;

关键词：

intercoder reliability; interrater reliability; qualitative analysis; interviews; coding; SOCIAL REPRESENTATIONS; INTERRATER RELIABILITY; PUBLIC ENGAGES; AGREEMENT; RIGOUR; STANDARDS; KAPPA;

D O I：

10.1177/1609406919899220

中图分类号：

C [社会科学总论];

学科分类号：

03 ; 0303 ;

摘要：

Evaluating the intercoder reliability (ICR) of a coding frame is frequently recommended as good practice in qualitative analysis. ICR is a somewhat controversial topic in the qualitative research community, with some arguing that it is an inappropriate or unnecessary step within the goals of qualitative analysis. Yet ICR assessment can yield numerous benefits for qualitative studies, which include improving the systematicity, communicability, and transparency of the coding process; promoting reflexivity and dialogue within research teams; and helping convince diverse audiences of the trustworthiness of the analysis. Few guidelines exist to help researchers negotiate the assessment of ICR in qualitative analysis. The current article explains what ICR is, reviews common arguments for and against its incorporation in qualitative analysis and offers guidance on the practical elements of performing an ICR assessment.

引用

页数：13

共 73 条

[1]

[Anonymous], PLOPPED DIFFER UNPUB

[2]

[Anonymous], 2004, CONTENT ANAL INTRO I

[3]

[Anonymous], 1999, RISK AND THE OTHER

[4]

[Anonymous], 2012, METH DEV NICE PUBL H

[5] The place of inter-rater reliability in qualitative research: An empirical study [J].

Armstrong, D ;

Gosling, A ;

Weinman, J ;

Marteau, T .

SOCIOLOGY-THE JOURNAL OF THE BRITISH SOCIOLOGICAL ASSOCIATION, 1997, 31 (03) :597-606

[6]

Attride-Stirling J., 2001, QUALITATIVE RES, V1, P385, DOI DOI 10.1177/146879410100100307

[7] Beyond kappa: A review of interrater agreement measures [J].

Banerjee, M .

CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1999, 27 (01) :3-23

[8] Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? [J].

Barbour, RS .

BMJ-BRITISH MEDICAL JOURNAL, 2001, 322 (7294) :1115-1117

[9]

Bauer M., 2000, QUALITATIVE RES TEXT, P3

[10]

Boyatzis R. E., 1998, TRANSFORMING QUALITA

← 1 2 3 4 5 6 7 8 →