Interactive piano training using augmented reality and the Internet of Things

The technology of augmented reality in education is a significant attempt to reform the training mode and develop education in general. Piano training usually includes using well-known computer means of teaching music on-screen and hardware. In this context, augmented reality (AR), alone and integrated with the Internet of Things (IoT), is a promising solution for interactive piano learning. The present study seeks to investigate the impacts of an AR and IoT assisted system for piano education on learners' musical literacy and piano skills (resonance, rhythm, coherence, pace, fingering, playing with both hands and legato playing). As an interactive learning environment, the study integrates HoloKeys, an AR application. This research builds on an empirical approach through a quasi-experiment. It involved 100 students of Tourism College of Zhejiang, China. The study participants were divided into control and experimental groups. The results showed that the experimental group achieved significantly higher results in a piano course than the control group. Hence, it confirms the positive perspective of using AR and the IoT in piano training. The research results can be useful to design and implement modern piano training courses. Thanks to the advantages that AR and IoT technologies offer when shaping interactive learning environments, the application of the present findings goes beyond music education and has the potential to boost learning in other specialties. Future research should focus on designing and developing AR learning tools and additional learning resources. These instruments will provide students with high-quality technical support for piano training.