Interactive Shape Modeling Using Leap Motion Controller

Compared to commonly used 2D tracking devices, 3D hand tracking by low-cost optical cameras can provide more degrees of freedom, as well as natural gestures for interaction done in virtual spaces. However, it is not considered to be precise enough for 3D modeling due to the problems of hand jitter, jump release, and occlusion. To avoid these problems, we propose to use bimanual interaction and separate the functions of a hand - the dominant hand controls 3D position and rotation, while the other hand controls grasping and releasing. This interaction is similar to playing the theremin - an electronic musical instrument controlled without physical contact by hands of the performer. Based on this method, we describe a generic set of reliable and precise interaction techniques for 3D shape modeling. A pilot user study shows that the proposed technique supports 3D modeling faster than that with Maya using mouse for a specific modeling example involving 3D manipulation and deformation. The results of the paper prove usefulness of optical hand tracking in precise 3D modeling.