Three-dimensional holographic communication system for the metaverse

We demonstrate a real-time three-dimensional communication system integrating the capture, hologram generation, transmission and display. The point cloud of a 3D scene is captured by a structured light camera and a light field camera. Phase-only computer-generated holograms are calculated by the layer-based angular spectrum method based on rendered depth images and shading images. The dynamic reconstruction of phase -only holograms is realized by a dynamic 4K liquid crystal spatial light modulator. The framerate of 20 fps and the latency of 0.1 s are realized, which can be satisfied by the 5G network. We suggest that this system is a potential solution to telepresence in the metaverse.