Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines

被引：1826
作者：
O'Connor, Cliodhna [1 ]
Joffe, Helene [2 ]
机构：
[1] Univ Coll Dublin, Sch Psychol, Dublin 4, Ireland
[2] UCL, Div Psychol & Language Sci, London, England
来源：
INTERNATIONAL JOURNAL OF QUALITATIVE METHODS | 2020年 / 19卷
基金：
欧盟地平线“2020”;
关键词：
intercoder reliability; interrater reliability; qualitative analysis; interviews; coding; SOCIAL REPRESENTATIONS; INTERRATER RELIABILITY; PUBLIC ENGAGES; AGREEMENT; RIGOUR; STANDARDS; KAPPA;
D O I：
10.1177/1609406919899220
中图分类号：
C [社会科学总论];
学科分类号：
03 ; 0303 ;
摘要：
Evaluating the intercoder reliability (ICR) of a coding frame is frequently recommended as good practice in qualitative analysis. ICR is a somewhat controversial topic in the qualitative research community, with some arguing that it is an inappropriate or unnecessary step within the goals of qualitative analysis. Yet ICR assessment can yield numerous benefits for qualitative studies, which include improving the systematicity, communicability, and transparency of the coding process; promoting reflexivity and dialogue within research teams; and helping convince diverse audiences of the trustworthiness of the analysis. Few guidelines exist to help researchers negotiate the assessment of ICR in qualitative analysis. The current article explains what ICR is, reviews common arguments for and against its incorporation in qualitative analysis and offers guidance on the practical elements of performing an ICR assessment.
引用
收藏
页数：13
相关论文
共 50 条
  • [21] Factors affecting intercoder reliability: a Monte Carlo experiment
    Guangchao Charles Feng
    Quality & Quantity, 2013, 47 : 2959 - 2982
  • [22] Guidelines for Establishing Reliability When Coding Narrative Data
    Syed, Moin
    Nelson, Sarah C.
    EMERGING ADULTHOOD, 2015, 3 (06) : 375 - 387
  • [23] Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
    Kottner, Jan
    Audige, Laurent
    Brorson, Stig
    Donner, Allan
    Gajewski, Byron J.
    Hrobjartsson, Asbjorn
    Roberts, Chris
    Shoukri, Mohamed
    Streiner, David L.
    INTERNATIONAL JOURNAL OF NURSING STUDIES, 2011, 48 (06) : 661 - 671
  • [24] Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
    Kottner, Jan
    Audige, Laurent
    Brorson, Stig
    Donner, Allan
    Gajewski, Byron J.
    Hrobjartsson, Asbjorn
    Roberts, Chris
    Shoukri, Mohamed
    Streiner, David L.
    JOURNAL OF CLINICAL EPIDEMIOLOGY, 2011, 64 (01) : 96 - 106
  • [25] Improving Visual Style Classification Information in Digital Games Using Intercoder Reliability Assessment
    Jamal, Jazmi Izwan
    Yusof, Mohd Hafizuddin Mohd
    Yoong, Lim Kok
    Jamal, Jamia Azdina
    JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGY-MALAYSIA, 2023, 22 (02): : 283 - 308
  • [26] HOW TO REPORT ON QUALITATIVE RESEARCH? GUIDELINES FOR RESEARCHERS, MENTORS AND REVIEWERS
    Ajdukovic, Marina
    LJETOPIS SOCIJALNOG RADA, 2014, 21 (03): : 345 - 366
  • [27] Data Analysis Methods for Qualitative Research: Managing the Challenges of Coding, Interrater Reliability, and Thematic Analysis
    Belotto, Michael J.
    QUALITATIVE REPORT, 2018, 23 (11) : 2622 - 2633
  • [28] Qualitative Surveys in Software Engineering Research: Definition, Critical Review, and Guidelines
    Melegati, Jorge
    Conboy, Kieran
    Graziotin, Daniel
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2024, 50 (12) : 3172 - 3187
  • [29] The place of inter-rater reliability in qualitative research: An empirical study
    Armstrong, D
    Gosling, A
    Weinman, J
    Marteau, T
    SOCIOLOGY-THE JOURNAL OF THE BRITISH SOCIOLOGICAL ASSOCIATION, 1997, 31 (03): : 597 - 606
  • [30] Reflexivity in research: Promoting rigour, reliability and validity in qualitative research
    Darawsheh, Wesam
    INTERNATIONAL JOURNAL OF THERAPY AND REHABILITATION, 2014, 21 (12) : 560 - 568
12345