Computer-Vision Based Gesture-Metasurface Interaction System for Beam Manipulation and Wireless Communication

Hand gesture plays an important role in many circumstances, which is one of the most common interactive methods in daily life, especially for disabled people. Human-machine interaction is another popular research topic to realize direct and efficient control, making machines intelligent and maneuverable. Here, a special human-machine interaction system is proposed and namedas computer-vision (CV) based gesture-metasurface interaction (GMI) system, which can be used for both direct beam manipulations and real-time wireless communications. The GMI system first needs to select its working mode according to the gesture command to determine whether to perform beam manipulations or wireless communications, and then validate the permission for further operation by recognizing unlocking gesture to ensure security. Both beam manipulation and wireless communication functions are validated experimentally, which show that the GMI system can not only realize real-time switching and remote control of different beams through gesture command, but also communicate with a remote computer in real time by translating the gesture language to text message. The proposed non-contact GMI system has the advantages of good interactivity, high flexibility, and multiple functions, which can find potential applications in community security, gesture-command smart home, barrier-free communications, and so on. A non-contact computer-vision-based gesture-metasurface interaction (GMI) system is proposed. It can recognize the gesture commands through computer vision, and convert them into electromagnetic signals via a metasurface for real-time beam manipulation and wireless communication. The proposed non-contact GMI system exhibits good interactivity, and is promising to be applied in community security, smart home, barrier-free communications, and so on.image