Development and Validation of Telehealth Competency Questionnaire-Provider

Background: Given the rapid increase in telehealth utilization, health care providers are being increasingly trained to deliver services virtually. However, there are limited measures available to assess the extent to which structured trainings influence competency domains associated with telehealth delivery. Methods: The authors developed the Telehealth Competency Questionnaire-Provider (TCQ-P) using a multistep process, including a literature review and expert reviewers. Using two datasets, we used exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to validate and refine the tool, respectively. The final version contained 17 items. Model fit was evaluated using the comparative fit index (CFI) (>0.90), Tucker-Lewis index (TLI) (>0.80), standardized root mean square residual (SRMR) (<0.08) and root mean square of error of approximation (RMSEA) (<0.08). Results: Participants included n = 701 in the exploratory study and n = 721 in the confirmatory study. Two items were revised, and one item was deleted as a result of the EFA, and the CFA of 17 number of items supported a 3-factor model (i.e., Evaluation, Rapport, Troubleshooting). Model fit was good, with CFI = 0.984, TLI = 0.978, RMSEA = 0.051, and SRMR = 0.035. Discussion: The TCQ-P measures three essential domains of telehealth competency, which is essential for future health care providers. The measure may be used to assess telehealth training outcomes.