Intercoder reliability indices: disuse, misuse, and abuse

被引：70
|
作者：
Feng, Guangchao Charles [1 ]
机构：
[1] Jinan Univ, Sch Journalism & Commun, Guangzhou, Guangdong, Peoples R China
来源：
QUALITY & QUANTITY | 2014年 / 48卷 / 03期
关键词：
Intercoder reliability; Content analysis; Misuse; HIGH AGREEMENT; LOW KAPPA; COEFFICIENT;
D O I：
10.1007/s11135-013-9956-8
中图分类号：
C [社会科学总论];
学科分类号：
03 ; 0303 ;
摘要：
Although intercoder reliability has been considered crucial to the validity of a content study, the choice among them has been controversial. This study analyzed all the content studies published in the two major communication journals that reported intercoder reliability, aiming to find how scholars conduct intercoder reliability test. The results revealed that some intercoder reliability indices were misused persistently concerning the levels of measurement, the number of coders, and the means of reporting reliability over the past 30 years. Implications of misuse, disuse, and abuse were discussed, and suggestions regarding proper choice of indices in various situations were made at last.
引用
收藏
页码：1803 / 1815
页数：13
相关论文
共 50 条
  • [31] Intercoder Reliability of Mapping Between Pharmaceutical Dose Forms in the German Medication Plan and EDQM Standard Terms
    Sass, Julian
    Becker, Kim
    Ludmann, Dominik
    Pantazoglou, Elisabeth
    Dewenter, Heike
    Thun, Sylvia
    BUILDING CONTINENTS OF KNOWLEDGE IN OCEANS OF DATA: THE FUTURE OF CO-CREATED EHEALTH, 2018, 247 : 845 - 849
  • [32] Abuse of immediate-release opioids and current approaches to reduce misuse, abuse and diversion
    Nalamachu, Srinivas R.
    Shah, Binit
    POSTGRADUATE MEDICINE, 2022, 134 (04) : 388 - 394
  • [33] Towards a cognitive forensic stylistics: An intercoder reliability test for replicable feature finding in the Operation Heron corpus
    Voice, Matthew
    Harrison, Chloe
    Grant, Tim
    Giovanelli, Marcello
    LANGUAGE AND LITERATURE, 2025,
  • [34] An algorithm to identify gabapentin misuse and/or abuse in administrative claims data
    Zhao, Danni
    Nunes, Anthony P.
    Baek, Jonggyu
    Lapane, Kate L.
    DRUG AND ALCOHOL DEPENDENCE, 2022, 235
  • [35] The impact of hydrocodone rescheduling on utilization, abuse, misuse, and overdose deaths
    Karami, Sara
    Ajao, Adebola
    Wong, Jennie
    Zhang, Di
    Meyer, Tamra
    Ding, Yulan
    Secora, Alex
    Major, Jacqueline M.
    Gill, Rajdeep
    Chai, Grace P.
    Zhao, Yueqin
    McAninch, Jana
    PHARMACOEPIDEMIOLOGY AND DRUG SAFETY, 2023, 32 (07) : 735 - 751
  • [36] Misuse of atypical antipsychotics in conjunction with alcohol and other drugs of abuse
    Malekshahi, Tara
    Tioleco, Nina
    Ahmed, Nahima
    Campbell, Aimee N. C.
    Haller, Deborah
    JOURNAL OF SUBSTANCE ABUSE TREATMENT, 2015, 48 (01) : 8 - 12
  • [37] Use and Misuse of Reliability Analyses for Unmanned Spacecraft Missions
    Dawson, Jeffrey W.
    2024 ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, RAMS, 2024,
  • [38] How Robust Are Multirater Interrater Reliability Indices to Changes in Frequency Distribution?
    Quarfoot, David
    Levine, Richard A.
    AMERICAN STATISTICIAN, 2016, 70 (04) : 373 - 384
  • [39] Clinical scoring algorithm for the prescription opioid misuse and abuse questionnaire (POMAQ)
    Coyne, Karin S.
    Schnoll, Sidney H.
    Butler, Stephen F.
    Barsdorf, Alexandra, I
    Currie, Brooke M.
    Maziere, Jean-Yves
    Pierson, Renee F.
    Porter, Leslie N.
    Franks, Capt Michael J., Jr.
    Farrar, John T.
    CURRENT MEDICAL RESEARCH AND OPINION, 2022, 38 (06) : 971 - 980
  • [40] Epidemiology of stimulant misuse and abuse: Implications for future epidemiologic and neuropharmacologic research
    Gerlach, Karen K.
    Dasgupta, Nabarun
    Schnoll, Sidney H.
    Henningfield, Jack E.
    NEUROPHARMACOLOGY, 2014, 87 : 91 - 96
12345