Novel workflow analysis of robot-assisted hysterectomy through objective performance indicators: a pilot study

Introduction: The curriculum for a da Vinci surgeon in gynecology requires special training before a surgeon performs their first independent case, but standardized, objective assessments of a trainee's workflow or skills learned during clinical cases are lacking. This pilot study presents a methodology to evaluate intraoperative surgeon behavior in hysterectomy cases through standardized surgical step segmentation paired with objective performance indicators (OPIs) calculated directly from robotic data streams. This method can provide individual case analysis in a truly objective capacity. Materials and methods: Surgical data from six robot-assisted total laparoscopic hysterectomies (rTLH) performed by two experienced surgeons was collected prospectively using an Intuitive Data Recorder. Each rTLH video was annotated and segmented into specific, functional surgical steps based on the recorded video. Once annotated, OPIs were compared through workflow analysis and across surgeons during two critical surgical steps: colpotomy and vaginal cuff closure. Results: Through visualization of the individual steps over time, we observe workflow consistencies and variabilities across individual surgeons of a similar experience level at the same hospital, creating unique surgeon behavior signatures across each surgical case. OPI differences across surgeons were observed for both the colpotomy and vaginal cuff closure steps, specifically reflecting camera movement, energy usage and clutching behaviors. Comparing colpotomy and vaginal cuff closure time needed for the step and the events of energy use were significantly different (p < 0.001). For the comparison between the two surgeons only the event count for camera movement during colpotomy showed significant differences (p = 0.03). Conclusion: This pilot study presents a novel methodology to analyze and compare individual rTLH procedures with truly objective measurements. Through collection of robotic data streams and standardized segmentation, OPI measurements for specific rTLH surgery steps can be reliably calculated and compared to those of other surgeons. This provides opportunity for critical standardization to the gynecology field, which can be integrated into individualized training plans in the future. However, more studies are needed to establish context surrounding these metrics in gynecology.