Affordance Maintenance-based 3D Scene Synthesis for Immersive Mixed Reality

With the explosion of head-mounted displays into the commercial market, immersive scenes are being used in many applications, e.g., training and entertainment. As these applications are usually used indoors, the user would suffer from safety and immersion issues when immersed in a virtual scene. Therefore, we propose a 3D synthesis method that synthesizes the 3D scene according to the affordance of physical objects in the situated physical environment and the intention of the user. The results show that virtual objects in synthetic scenes have the same affordances as physical objects in the real world and can provide interaction medium and feedback to the situated user and avoid collisions.