Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines

被引：1821
|
作者：
O'Connor, Cliodhna [1 ]
Joffe, Helene [2 ]
机构：
[1] Univ Coll Dublin, Sch Psychol, Dublin 4, Ireland
[2] UCL, Div Psychol & Language Sci, London, England
来源：
INTERNATIONAL JOURNAL OF QUALITATIVE METHODS | 2020年 / 19卷
基金：
欧盟地平线“2020”;
关键词：
intercoder reliability; interrater reliability; qualitative analysis; interviews; coding; SOCIAL REPRESENTATIONS; INTERRATER RELIABILITY; PUBLIC ENGAGES; AGREEMENT; RIGOUR; STANDARDS; KAPPA;
D O I：
10.1177/1609406919899220
中图分类号：
C [社会科学总论];
学科分类号：
03 ; 0303 ;
摘要：
Evaluating the intercoder reliability (ICR) of a coding frame is frequently recommended as good practice in qualitative analysis. ICR is a somewhat controversial topic in the qualitative research community, with some arguing that it is an inappropriate or unnecessary step within the goals of qualitative analysis. Yet ICR assessment can yield numerous benefits for qualitative studies, which include improving the systematicity, communicability, and transparency of the coding process; promoting reflexivity and dialogue within research teams; and helping convince diverse audiences of the trustworthiness of the analysis. Few guidelines exist to help researchers negotiate the assessment of ICR in qualitative analysis. The current article explains what ICR is, reviews common arguments for and against its incorporation in qualitative analysis and offers guidance on the practical elements of performing an ICR assessment.
引用
收藏
页数：13
相关论文
共 50 条
  • [1] Process guidelines for establishing Intercoder Reliability in qualitative studies
    MacPhail, Catherine
    Khoza, Nomhle
    Abler, Laurie
    Ranganathan, Meghna
    QUALITATIVE RESEARCH, 2016, 16 (02) : 198 - 212
  • [2] Intercoder Reliability for Use in Qualitative Research and Evaluation
    Coleman, Monica L.
    Ragan, Moira
    Dari, Tahani
    MEASUREMENT AND EVALUATION IN COUNSELING AND DEVELOPMENT, 2024, 57 (02) : 136 - 146
  • [3] ccTaming our wild data: On intercoder reliability in discourse research
    van Enschot, Renske
    Spooren, Wilbert
    van den Bosch, Antal
    Burgers, Christian
    Degand, Liesbeth
    Evers-Vermeul, Jacqueline
    Kunneman, Florian
    Liebrecht, Christine
    Linders, Yvette
    Maes, Alfons
    DUTCH JOURNAL OF APPLIED LINGUISTICS, 2024, 13
  • [4] Coding In-depth Semistructured Interviews: Problems of Unitization and Intercoder Reliability and Agreement
    Campbell, John L.
    Quincy, Charles
    Osserman, Jordan
    Pedersen, Ove K.
    SOCIOLOGICAL METHODS & RESEARCH, 2013, 42 (03) : 294 - 320
  • [5] Intercoder reliability indices in tourism research
    Park, Seunghyun Brian
    Park, Kwangsoo
    ANNALS OF TOURISM RESEARCH, 2015, 55 : 180 - 183
  • [6] Visual and Statistical Methods to Calculate Intercoder Reliability for Time-Resolved Observational Research
    Malviya, Manoj
    Buswell, Natascha T.
    Berdanier, Catherine G. P.
    INTERNATIONAL JOURNAL OF QUALITATIVE METHODS, 2021, 20
  • [7] Factors affecting intercoder reliability: a Monte Carlo experiment
    Feng, Guangchao Charles
    QUALITY & QUANTITY, 2013, 47 (05) : 2959 - 2982
  • [8] The use of intercoder reliability in qualitative interview data analysis in science education
    Cheung, Kason Ka Ching
    Tai, Kevin W. H.
    RESEARCH IN SCIENCE & TECHNOLOGICAL EDUCATION, 2023, 41 (03) : 1155 - 1175
  • [9] Developing and Assessing Intercoder Reliability in Studies of Group Interaction
    Compton, D'Lane
    Love, Tony P.
    Sell, Jane
    SOCIOLOGICAL METHODOLOGY 2012, VOL 42, 2012, 42 : 348 - 364
  • [10] Mistakes and How to Avoid Mistakes in Using Intercoder Reliability Indices
    Feng, Guangchao Charles
    METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES, 2015, 11 (01) : 13 - 22
12345