Research on the UAV Multi-channel Human-Machine Interaction System

To integrate speech, touch, and gesture into an Unmanned Aerial Vehicle (UAV) Ground Control Station (GCS) interaction. The multi-channel framework of human-machine interaction (HMI) are designed based on the virtual simulation technology. First, establish a virtual UAV cockpit model using virtual simulation ways, furthermore, propose the integration method of the different channels including speech, touch and gesture. Finally, an experiment based on KLM striking model is conducted, which shows that multi-channel increases the efficiency comparing to traditional GCS. The conclusion of this research has a significant reference on the multi-channel cockpit design, especially for the UAV GCS.