Distributional Validity and Prognostic Power of the National Institutes of Health Stroke Scale in US Administrative Claims Data

Importance Comparative assessment of acute ischemic stroke care quality provided by hospitals in the United States has been hampered by the unavailability of the National Institutes of Health Stroke Scale (NIHSS) in administrative data sets, preventing adequate adjustment for variations in patient case-mix risk. In response to stakeholder concerns, the US Centers for Medicare & Medicaid Services in 2016 implemented optional reporting of NIHSS scores. Objective To analyze the distributional, convergent, and predictive validity of nationally submitted NIHSS values in the National Inpatient Sample. Design, Setting, and Participants This population-based retrospective cross-sectional study took place from October 1 to December 31, 2016. The nationally representative sample included US adults who had ischemic stroke hospitalizations during the first calendar quarter in which optional NIHSS reporting was implemented. Analysis began September 2019. Main Outcomes and Measures Distribution of NIHSS scores, functional independence at discharge, inpatient mortality, and administrative reporting of NIHSS. Results Among 154 & x202f;165 ischemic stroke hospitalizations during the first 3 months of the reporting policy, NIHSS scores were reported in 21 & x202f;685 patients (14%) (10 & x202f;925 women [50.4%]; median [interquartile range] age, 72 [61-82] years). Median (interquartile range) NIHSS score was 4 (2-11), and frequency of severity categories included absent (NIHSS score, 0) in 2080 patients (9.6%), minor (NIHSS score, 1-4) in 8760 patients (40.4%), and severe (NIHSS score, 21-42) in 1930 patients (8.9%). National Institutes of Health Stroke Scale score of 10 or more, an indicator of possible large vessel occlusions, was present in 6290 patients (29%). Presenting NIHSS score was higher in very elderly patients (age >= 80 y) and women and also in patients receiving endovascular thrombectomy vs intravenous thrombolysis alone vs no reperfusion therapy (median [interquartile range], 17 [12-22] vs 6 [4-12] vs 4 [2-9], respectively) (P < .001). National Institutes of Health Stroke Scale scores were similarly higher for discharge outcomes of mortality vs discharge to skilled nursing facility vs discharge home (median [interquartile range], 19 [12-25] vs 7 [3-15] vs 2 [1-5], respectively) (P < .001). Likelihood of NIHSS scores being reported independently increased with interfacility transfer, receipt of acute reperfusion therapies, larger hospital size, academic centers, and region other than the West. Conclusions and Relevance In the initial national optional reporting period in the United States, NIHSS scores were reported in nearly 1 in 7 ischemic stroke hospitalizations. The distribution of NIHSS scores was similar to that from narrow population-based studies and registries, and NIHSS scores were powerfully associated with discharge outcome, supporting the validity and potential to aid care quality assessment. This cross-sectional study analyzes the distributional, convergent, and predictive validity of National Institutes of Health Stroke Scale (NIHSS) values in the National Inpatient Sample. Question Do the National Institutes of Health Stroke Scale (NIHSS) deficit severity scores reported by US hospitals nationally show expected distribution patterns and outcome-predictive power? Findings In this cross-sectional study of 154 & x202f;165 ischemic stroke admissions in the US National Inpatient Sample, optionally reported NIHSS scores were recorded in nearly 1 in 7 patients. The NIHSS score distribution nationally was similar to that in clinical registries and population-based studies, with associations with functional outcome and early mortality. Meaning These data support the validity and robust prognostic power of national, administratively reported NIHSS scores, highlighting their potential to aid care quality assessment in the United States.