The Virtual Surgery of Extraocular Muscles Based on Gesture Interaction

Virtual surgery is a process which uses virtual reality technology to realize surgery simulation, it can provide doctors with real-life experience of visual, auditory, tactile and so on, and it also plays an important role in surgical training and planning. During the interactive process, we used Leap Motion Controller to obtain hand information such as user hand joint positions, posture, fingers. We used the feature vector extracted from the doctor's hand to recognize the gesture, and then completed the process of virtual surgery through a combination of gestures. In the end, this thesis verified the gesture control and filtering effect on the virtual surgery platform of extraocular muscles based on gesture interaction in the laboratory. The traditional virtual surgery system needs the doctor to perform the operation using mouse and keyboard and other touched equipment, which may pollute the environment of surgery. Our method uses hand gestures to perform the operation. It is not only natural and easy for doctor to control the machine, but also make the environment cleaner.