Making the Invisible Visible: Guidelines for the Coding Process in Meta-Analyses

被引:25
作者
Villiger, Jessica [1 ]
Schweiger, Simone A. [1 ]
Baldauf, Artur [1 ]
机构
[1] Univ Bern, Engehaldenstr 4, CH-3012 Bern, Switzerland
关键词
coding process; guidelines; recommendations; coding approach; data extraction; categorization; reporting; transparency; rigor; meta-analysis; meta-analytic review; systematic literature review; state-of-the-art assessment; methodological resources; JUDGMENT CALLS; ENTREPRENEURIAL ORIENTATION; ORGANIZATIONAL SCIENCES; WORK ENGAGEMENT; PERFORMANCE; MANAGEMENT; TEAMS; DETERMINANTS; TASK; TRANSPARENCY;
D O I
10.1177/10944281211046312
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
This article contributes to the practice of coding in meta-analyses by offering direction and advice for experienced and novice meta-analysts on the "how" of coding. The coding process, the invisible architecture of any meta-analysis, has received comparably little attention in methodological resources, leaving the research community with insufficient guidance on "how" it should be rigorously planned (i.e., cohere with the research objective), conducted (i.e., make reliable and valid coding decisions), and reported (i.e., in a sufficiently transparent manner for readers to comprehend the authors' decision-making). A lack of rigor in these areas can lead to erroneous results, which is problematic for entire research communities who build their future knowledge upon meta-analyses. Along four steps, the guidelines presented here elucidate "how" the coding process can be performed in a coherent, efficient, and credible manner that enables connectivity with future research, thereby enhancing the reliability and validity of meta-analytic findings. Our recommendations also support editors and reviewers in advising authors on how to improve the rigor of their coding and ultimately establish higher quality standards in meta-analytic research.
引用
收藏
页码:716 / 740
页数:25
相关论文
共 102 条
  • [1] Best-Practice Recommendations for Producers, Evaluators, and Users of Methodological Literature Reviews
    Aguinis, Herman
    Ramani, Ravi S.
    Alabduljader, Nawaf
    [J]. ORGANIZATIONAL RESEARCH METHODS, 2023, 26 (01) : 46 - 76
  • [2] WHAT YOU SEE IS WHAT YOU GET? ENHANCING METHODOLOGICAL TRANSPARENCY IN MANAGEMENT RESEARCH
    Aguinis, Herman
    Ramani, Ravi S.
    Alabduljader, Nawaf
    [J]. ACADEMY OF MANAGEMENT ANNALS, 2018, 12 (01) : 83 - 110
  • [3] Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact
    Aguinis, Herman
    Dalton, Dan R.
    Bosco, Frank A.
    Pierce, Charles A.
    Dalton, Catherine M.
    [J]. JOURNAL OF MANAGEMENT, 2011, 37 (01) : 5 - 38
  • [4] DEMOGRAPHY AND DESIGN - PREDICTORS OF NEW PRODUCT TEAM PERFORMANCE
    ANCONA, DG
    CALDWELL, DF
    [J]. ORGANIZATION SCIENCE, 1992, 3 (03) : 321 - 341
  • [5] Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report
    Appelbaum, Mark
    Cooper, Harris
    Kline, Rex B.
    Mayo-Wilson, Evan
    Nezu, Arthur M.
    Rao, Stephen M.
    [J]. AMERICAN PSYCHOLOGIST, 2018, 73 (01) : 3 - 25
  • [6] Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses
    Aytug, Zeynep G.
    Rothstein, Hannah R.
    Zhou, Wencang
    Kern, Mary C.
    [J]. ORGANIZATIONAL RESEARCH METHODS, 2012, 15 (01) : 103 - 133
  • [7] Bhaskar-Shrinivas P, 2005, ACAD MANAGE J, V48, P257, DOI 10.2307/20159655
  • [8] Transfer of Training: A Meta-Analytic Review
    Blume, Brian D.
    Ford, J. Kevin
    Baldwin, Timothy T.
    Huang, Jason L.
    [J]. JOURNAL OF MANAGEMENT, 2010, 36 (04) : 1065 - 1105
  • [9] Booth A., 2016, SYSTEMATIC APPROACHE
  • [10] Borenstein M, 2009, Introduction to Meta-Analysis