Real-time video avatar generation method for realistic communication in the metaverse

In this study, we implemented a real-time video avatar generation method using image processing and machine learning to develop a new advanced communication tool that enables information sharing and decision-making. Using the proposed method, users can easily send their real-time video avatars to the metaverse. We evaluated a questionnaire survey on 12 subjects to evaluate the effectiveness of the proposed real-time video avatar generation method. This evaluation was conducted based on the sense of being in the same room, degree of concentration, degree of communication of non-verbal information, ease of timing utterances and naturalness of conversation for 12 subjects. The 12 subjects held discussions using video conferencing and our proposed metaverse conferencing systems with real-time video avatars and answered some evaluation questionnaires. The evaluation results revealed that our proposed metaverse conferencing system using real-time video avatars is superior to the video conferencing system in all evaluation items.