Disagreement Between Hospital Rating Systems: Measuring the Correlation of Multiple Benchmarks and Developing a Quality Composite Rank

In the United States, hospital rating system usefulness is limited by heterogeneity and conflicting results. US News Best Hospitals, Vizient Quality and Accountability Study, Centers for Medicare & Medicaid Services (CMS) Star Rating, Leapfrog Hospital Safety Grade, and the Truven Top 100 Hospitals ratings were compared using Spearman correlations. Rank aggregation was used to combine the scores generating a Quality Composite Rank (QCR). The highest correlation between rating systems was shown between the Leapfrog Safety Grade and the CMS Star Rating. In a proportional odds logistic regression, a greater discordance between the CMS Star Rating, Vizient rank, US News, and Leapfrog was associated with a lower overall rank in the QCR. Lack of transparency and understanding about the differences and similarities for these hospital ranking systems complicates use of the measures. By combining the results of these ranking systems into a composite, the measurement of hospital quality can be simplified.