Exclusion Criteria in National Health State Valuation Studies: A Systematic Review

Background. Health state valuation data are often excluded from studies that aim to provide a nationally representative set of values for preference-based health-related quality of life (HRQoL) instruments. The purpose was to provide a systematic examination of exclusion criteria used in the derivation of societal scoring algorithms for preference-based HRQoL instruments. Methods. Data sources included MEDLINE, official instrument websites, and publication reference lists. Analyses that used data from national valuation studies and reported a scoring algorithm for a generic preference-based HRQoL instrument were included. Data extraction included exclusion criteria and associated justifications, exclusion rates, the characteristics of excluded respondents, and analyses that explored consequential implications of exclusion criteria on the respective national tariff. Results. Seventy-six analyses (from 70 papers) met the inclusion criteria. In addition to being excluded for logical inconsistencies, respondents were often excluded if they valued fewer than 3 health states or if they gave the same value to all health states. Numerous other exclusion criteria were identified, with varying degrees of justification, often based on an assumption that respondents did not understand the task or as a consequence of the chosen statistical modeling techniques. Rates of exclusion ranged from 0% to 65%, with excluded respondents more likely to be older, less educated, and less healthy. Limitations included that the database search was confined to MEDLINE; study selection focused on national valuation studies that used standard gamble, time tradeoff, and/or visual analog scale techniques; and only English-language studies were included. Conclusion. Exclusion criteria used in national valuation studies vary considerably. Further consideration is necessary in this important and influential area of research, from the design stage to the reporting of results.