Multiplayer collaborative training system based on Mobile AR innovative interaction technology

The applications of Augmented Reality (AR) in such mobile devices as phones and pads can enhance the users' experiences both in virtual and real world. In this paper the design and implementation of a Multiplayer Collaborative Training System (MCTS) is presented. It is a combination of virtual and physical reality, which builds virtual worlds with changeable scenes, brings authentic user experience and records process for analyzing and evaluation. Players are trained in a closed environment, which is composed of projectors, multimedia devices and physical scene. The application of mobile AR device guides the entire training process, and users make effective interaction with mobile devices to start and finish training mission. In the proposed system five innovative methods are implemented to improve interaction quality. An experiment case is devised with a series of tasks and conundrums for players, experimental results show that the MCTS can contribute more effective educations on team consciousness through the use of mobile AR technology and multimodal interaction to integrate virtual and real experience.