Voice-Augmented Virtual Reality Interface for Serious Games

This paper introduces a Voice-Augmented Virtual Reality (VR) Interface designed to enhance the experience of interacting with 3D models in virtual reality environments, specifically targeting serious games and learning environments. Leveraging natural language as the primary mode of interaction, this paper presents a framework and a study that compares the voice-augmented system with a conventional hand controller version across seven fundamental 3D interaction tasks. The research explores a wide range of object interactions and offers a comprehensive voice-augmented VR interface. The system presents a more accessible and equitable alternative to controller-based interactions. This is demonstrated by a user study that compares the experiences of male and female participants engaging with the system.