Ophthalmic Simulated Surgical Competency Assessment Rubric for manual small-incision cataract surgery

Purpose: To develop and test the validity of a surgical competency assessment tool for simulated small-incision cataract surgery (SICS). Setting: Participating ophthalmologists contributed from 8 countries. Design: Qualitative and quantitative development and evaluation of face and content validity of an assessment rubric, and evaluation of construct validity and reliability. Methods: The SICS Ophthalmic Simulated Surgical Competency Assessment Rubric (Sim-OSSCAR) was developed and assessed for face and content validity by an international group of experienced ophthalmologists. Groups of novice and competent surgeons from 4 countries were recorded performing surgery, and masked assessments were performed by 4 expert surgeons, to determine construct validity and reliability. Results: The Sim-OSSCAR for SICS was assessed by a panel of 12 international experts from 8 countries. In response to the question, "Do you think the OSSCAR represents the surgical techniques and skills upon which trainees should be assessed'?," all respondents either agreed or strongly agreed. Face validity was rated as 4.60 (out of 5.0). The content was iteratively agreed to by the panel of experts; final content validity was rated as 4.5. Interobserver reliability was assessed, and 17 of 20 items in the assessment matrix had a Krippendorff alpha correlation of more than 0.6. A Wilcoxon ranksum test showed that competent surgeons perform better than novices (P = .02). Conclusions: This newly developed and validated assessment tool for simulation SICS, based on the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric, has good face and content validity. It can play a role in ophthalmic surgical education. (C) 2019 The Authors. Published by Elsevier Inc. on behalf of ASCRS and ESCRS.