CHOICE OF SOFTWARE AND PROGRAMS IN METAANALYSIS RESEARCH - DOES IT MAKE A DIFFERENCE

Along with the increased popularity of meta-analysis, a number of articles have questioned and highlighted the role that judgment calls play in the implementation and, ultimately, outcomes of studies that use this technique. In the absence of standardized data analyses packages, and coupled with the wide range of options available to meta-analysts, the current study investigated the effect of choice of data analysis programs on meta-analysis study outcomes. The research objective was to investigate the extent to which four commonly used Schmidt and Hunter validity generalization-based meta-analysis software programs, all based on the same conceptual and theoretical assumptions, produced identical outcomes when used to analyze the same data set. The results indicate that, although there are some differences in values obtained from the programs, these differences tended to be very small, typically occurring in the fourth and sometimes fifth decimal place, and did not influence the meta-analytic outcomes.