AR in the OR: exploring use of augmented reality to support endoscopic surgery

Modern operating rooms (OR) are equipped with several ceiling-and wall-mounted screens that display surgical information. These physical displays are restricted in placement, limiting the surgeons' ability to freely position them in the environment. Our work addresses this issue by exploring the feasibility of using an augmented reality (AR) headset (Microsoft HoloLens 2) as an alternative to traditional surgical screens; leading to a reduced OR footprint and improved surgical ergonomics. We developed several prototypes using state-of-the-art hardware/software and conducted various neurosurgery-related exploratory studies. Initial feedback from users suggests that coloration and resolution of the holographic feed were adequate, however, surgeons frequently commented on tactile/visual asynchrony. This emphasizes the need for novel, more efcient hardware/software solutions to support fne motor tasks in the OR.