Content validation of a quantitative stakeholder engagement measure

Aim Using a stakeholder-engaged approach, this study conducted content validation and item reduction of a quantitative measure of research engagement. Methods A five-round modified Delphi process was used to reach consensus on items. Rounds 1-3 and 5 were conducted using web-based surveys. Round 4 consisted of a 2-day, in-person meeting. Delphi panelists received individualized reports outlining individual and aggregate group responses after rounds 1-3. Results Over the five-round process, items were added, dropped, modified, and moved from one engagement principle to another. The number of items was reduced from 48 to 32, with three to five items corresponding to eight engagement principles. Conclusions Research that develops standardized, reliable, and accurate measures to assess stakeholder engagement is essential to understanding the impact of engagement on scientific discovery and the scientific process. Valid quantitative measures to assess stakeholder engagement in research are necessary to assess associations between engagement and research outcomes.