A Real-Time Visualization System of Muscle Activity in Movements Using VR Device

We developed a system that visualizes the position and pseudo-muscle activity used during exercise in the VR space. In this prototype, we proposed visualizing muscle activity during exercise by two patterns: the position of muscles and the magnitude of muscle activity visualized by color and the expansion movement of muscles visualized by deformation of CG objects. The visualization color differs for each body motion, and the user can recognize intuitively the location of the muscles used during the body motion and the magnitude of the muscle activity based on the user's input. It controls the scale of CG objects based on the features calculated from the CG avatars operated by the user. In addition, this system can assign controller inputs to different parts of the body, converting not only hand but also hand movements into foot movements for operation. These methods allow users to observe their own muscle activity in real time.