Is private sustainability governance a myth? Evaluating major sustainability certifications in primary production: A mixed methods meta-study

Sustainability certification (SC) is one of the most popular private sector approaches to govern social and environmental outcomes of trade in products from agriculture, forestry and fisheries. Based on a sample of 175 peer-reviewed articles, we use a novel mixed methods meta-analytical approach to study the success of major sustainability certifications in promoting sustainable (primary) production practices. We consider both qualitative and quantitative studies. Our main data source are the discussion and conclusion sections of research papers. We analyze conclusive statements about the success of SCs and categorize them into favorable, mixed, and skeptical evaluations. The picture is dominated by skeptical conclusions. Subsequently, we analyze how specific study characteristics affect this evaluation. The distribution of favorable, mixed, and skeptical evaluations is largely similar across the areas of economic, social, and environmental sustainability. Over time, the share of skeptical evaluations has increased. Contextual factors such as primary sub-sector, or country show no significant effects. The evaluations are also largely consistent across different types of SCs. Studies focusing on endpoint sustainability outcomes evaluate the performance of SCs significantly more skeptical than studies that focus on intermediate sustainability outcomes. Furthermore, our study shows that the share of skeptical evaluations significantly increases when a study examines the success of SCs for outcome variables with high implementation costs. Overall, our review points towards a limited success of SCs.