IMPROMPTU CONDUCTOR - A VIRTUAL-REALITY SYSTEM FOR MUSIC GENERATION BASED ON SUPERVISED LEARNING

This paper presents the 'Impromptu Conductor' virtual reality system which combines computer graphics and music, with the emphasis on computer music. We introduce the supervised learning method from the field of pattern recognition into the reproduction and the organization of music. We have proposed and implemented a practical way of capturing human motion to create music as well as generating the corresponding images on a screen by using a 6D tracker to simulate the user's hand in real time. However, the mapping between music and hand motion in our system is not a simple one-to-one function, and is constrained and properly modified by music styles collected from supervised learning. Thus the music style produced by an interactive user strongly depends on the movement of their hands. The system implemented demonstrates that the system designer can give different styles of feedback to different patterns of a user's behaviour.