Implementation of a User-Friendly Drone Control Interface Using Hand Gestures and Vibrotactile Feedback

被引：2

作者：

Lee J.W. ^{[1
]}

Kim K.-J. ^{[2
]}

Yu K.-H. ^{[1
,2
]}

机构：

[1] Department of Aerospace Engineering, Jeonbuk National University

[2] Future Air Mobility Research Center, Jeonbuk National University

来源：

Journal of Institute of Control, Robotics and Systems | 2022年 / 28卷 / 04期

关键词：

hand gesture recognition; user-friendly drone controller; vibrotactile feedback;

D O I：

10.5302/J.ICROS.2022.22.8004

中图分类号：

学科分类号：

摘要：

With the increasing use of drones, drone-related accidents have also increased. The main cause of these accidents is associated with the operational issue due to the difficulty of manipulation, especially for a novice. In this paper, a user-friendly drone control interface with hand gesture recognition and vibrotactile feedback is proposed to present additional information on obstacles distributed in the flight environment. Sensitivity analysis was performed to determine the key parameters of hand gestures and with these results, deep learning-based gesture recognition was developed. To effectively avoid obstacles around a drone, the vibration intensity was adjusted according to the distance between the drone and its obstacles. To demonstrate the effectiveness of the proposed system, drone flight simulation and a preliminary experiment were conducted. Results indicate that the proposed interface is useful for controlling drone more intuitively and safely. © 2022, Institute of Control, Robotics and Systems. All rights reserved.

引用

页码：349 / 352

页数：3

共 8 条

[1]

Son J.H., Kang D.H., Hwang D.H., Pedestrian motion recognition algorithms using smartphone accelerometer, Journal of Institute of Control, Robotics and Systems (In Korean), 27, 11, pp. 835-844, (2021)

[2]

Jo Y.U., Oh D.C., Real-time hand gesture prediction using deep learning by EMG data acquisition section, Journal of Institute of Control, Robotics and Systems (In Korean), 27, 5, pp. 349-355, (2021)

[3]

Shin S.Y., Kang Y.W., Kim Y.G., Hand gesture-based wearable human-drone interface for intuitive movement control, IEEE International Conference on Consumer Electronics, pp. 1-6, (2019)

[4]

Delpreto J., Rus D., Plug-and-play gesture control using muscle and motion sensors, Proc. of the 2020 Association for Computing Machinery/IEEE International Conference on Human-Robot Interaction, pp. 439-448, (2020)

[5]

Brandt M., Colton M.B., Haptic collision avoidance for a remotely operated quadrotor UAV in indoor environments, IEEE International Conference on Systems, Man and Cybernetics, pp. 2724-2731, (2010)

[6]

Rognon C., Ramachandran V., Wu A.R., Ijspeert A.J., Floreano D., Haptic feedback perception and learning with cable-driven guidance in exosuit teleoperation of a simulated drone, IEEE Transactions on Haptics, 12, 3, pp. 375-385, (2019)

[7]

Lee J.W., Kim K.J., Yu K.H., Development of user-friendly drone control interface based on hand gesture recognition and vibrotactile feedback, Proc. of 2021ICROS Jeonbuk-Jeju Regional Conference (In Korean), (2021)

[8]

Lee J.W., Development of a user-friendly drone controller using deep learning-based hand gesture recognition and vibrotactile feedback, M.S. Thesis, Dept. Aerospace Engineering, Jeonbuk National University, Jeonju, Korea, (2021)

← 1 →