Pharmacy Student Perceptions and Preferences of In-person Versus Video-Recorded Evaluations in Skills-Based Courses

Objective. To determine pharmacy students' preferences for and perceptions of in-person and video evaluations. Methods. A mixed methods survey was administered to 447 first-, second-, and third-year students enrolled in a public US Doctor of Pharmacy program. A survey instrument with 14 quantitative items and four qualitative items was used to measure student perceptions. Eight response choice items measured preferences. Paired t tests were used to compare students' perceptions. Independent t tests were used to compare perceptions between students who experienced and had not experienced video evaluations. Two researchers performed thematic content analysis of the qualitative responses. Results. Students (n5444, 99.3% response rate) perceived in-person evaluations more positively for all items except nervousness. Students who experienced video technology felt significantly more positive about video evaluations than students who had little or no experience using video technology on nine items. The students who experienced video technology felt significantly less positive toward video evaluations in terms of quality (1.24 vs. 0.83) and amount (1.14 vs 0.77) of written feedback. Although students valued the interaction with a larger, more diverse pool of evaluators that was made possible by video evaluations, they did not view video technology as applicable to their future practice. Conclusion. Students viewed in-person evaluations significantly more positively than video evaluations. This effect was mitigated by greater exposure to video technology, suggesting that concerns regarding video evaluations are based on conjecture rather than experience. This study highlights the need to reduce the technological issues associated with video evaluations and improve the written feedback provided to students.