The Reporting Quality of Systematic Reviews and Meta-Analyses in Industrial and Organizational Psychology: A Systematic Review

被引:34
作者
Schalken, Naomi [1 ]
Rietbergen, Charlotte [1 ]
机构
[1] Univ Utrecht, Fac Social & Behav Sci, Dept Methodol & Stat, Utrecht, Netherlands
关键词
systematic review; reporting quality; transparency; industrial and organizational psychology; MARS; replicability; JUDGMENT CALLS; PERFORMANCE; DECISIONS; PERSONALITY; CONCLUSIONS; TRIALS;
D O I
10.3389/fpsyg.2017.01395
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Objective: The goal of this systematic review was to examine the reporting quality of the method section of quantitative systematic reviews and meta-analyses from 2009 to 2016 in the field of industrial and organizational psychology with the help of the Meta-Analysis Reporting Standards (MARS), and to update previous research, such as the study of Aytug et al. (2012) and Dieckmann et al. (2009). Methods: A systematic search for quantitative systematic reviews and meta-analyses was conducted in the top 10 journals in the field of industrial and organizational psychology between January 2009 and April 2016. Data were extracted on study characteristics and items of the method section of MARS. A cross-classified multilevel model was analyzed, to test whether publication year and journal impact factor (JIF) were associated with the reporting quality scores of articles. Results: Compliance with MARS in the method section was generally inadequate in the random sample of 120 articles. Variation existed in the reporting of items. There were no significant effects of publication year and journal impact factor (JIF) on the reporting quality scores of articles. Conclusions: The reporting quality in the method section of systematic reviews and meta-analyses was still insufficient, therefore we recommend researchers to improve the reporting in their articles by using reporting standards like MARS.
引用
收藏
页数:12
相关论文
共 27 条
[1]   Impact of meta-analytic decisions on the conclusions drawn on the business value of information technology [J].
Ada, Serkan ;
Sharman, Raj ;
Balkundi, Prasad .
DECISION SUPPORT SYSTEMS, 2012, 54 (01) :521-533
[2]   Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact [J].
Aguinis, Herman ;
Dalton, Dan R. ;
Bosco, Frank A. ;
Pierce, Charles A. ;
Dalton, Catherine M. .
JOURNAL OF MANAGEMENT, 2011, 37 (01) :5-38
[3]   Best-practice recommendations for estimating interaction effects using moderated multiple regression [J].
Aguinis, Herman ;
Gottfredson, Ryan K. .
JOURNAL OF ORGANIZATIONAL BEHAVIOR, 2010, 31 (06) :776-786
[4]   A Review of Meta-Analyses in Education: Methodological Strengths and Weaknesses [J].
Ahn, Soyeon ;
Ames, Allison J. ;
Myers, Nicholas D. .
REVIEW OF EDUCATIONAL RESEARCH, 2012, 82 (04) :436-476
[5]  
[Anonymous], AGING RES METHODOLOG
[6]  
[Anonymous], 2016, J CIT REP
[7]   Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses [J].
Aytug, Zeynep G. ;
Rothstein, Hannah R. ;
Zhou, Wencang ;
Kern, Mary C. .
ORGANIZATIONAL RESEARCH METHODS, 2012, 15 (01) :103-133
[8]   METHODOLOGIC GUIDELINES FOR SYSTEMATIC REVIEWS OF RANDOMIZED CONTROL TRIALS IN HEALTH-CARE FROM THE POTSDAM CONSULTATION ON METAANALYSIS [J].
COOK, DJ ;
SACKETT, DL ;
SPITZER, WO .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 1995, 48 (01) :167-171
[9]   Reporting Standards for Research in Psychology Why Do We Need Them? What Might They Be? [J].
Cooper, Harris ;
Maxwell, Scott ;
Stone, Arthur ;
Sher, Kenneth J. .
AMERICAN PSYCHOLOGIST, 2008, 63 (09) :839-851
[10]   Viewing systematic reviews and meta-analysis in social research through different lenses [J].
Davis, Jacqueline ;
Mengersen, Kerrie ;
Bennett, Sarah ;
Mazerolle, Lorraine .
SPRINGERPLUS, 2014, 3