3D Interaction Design: Increasing the Stimulus-Response Correspondence by using Stereoscopic Vision

This paper presents a hand-based interaction approach for grabbing and manipulating virtual objects within immersive virtual environments. Considering the stimulus-response of humans, interacting with objects is easier if depth information is provided by stereoscopic vision. However, most people are used to work in monoscopic virtual environments. Therefore, we propose a case study, to analyze if an interaction approach using stereoscopic vision, compared to a conventional monoscopic vision, results in a higher user acceptance and stimulus-response correspondence. Our interaction approach is based on a robust and fast running 3D hand-and head-tracking provided by Microsoft's Kinect. We present a simple non-collision-based method for grabbing and manipulating objects within a 3D virtual environment. By tracking the head, the user is able to move within the environment and interact depending on his current position. The use of stereoscopic vision allows a natural and instinctive hand interaction with the augmented object. Finally, the experimental results and studies show how the use of stereoscopic vision improves the mental mapping and thus the user acceptance and stimulus-response correspondence in consideration of using the here presented interaction approach.