Sensor Design for Hand Gesture Capturing and Master-Slave Hand Motion Mapping

被引:0
作者
Zhang Y. [1 ]
Huang Y. [1 ]
Liu J. [1 ]
Liu P. [1 ]
Zhang Y. [1 ]
机构
[1] School of Electronic Science & Applied Physics, Hefei University of Technology, Hefei
来源
Jiqiren/Robot | 2019年 / 41卷 / 02期
关键词
Hand gesture capturing; Kinematics; Master-slave hand; Motion mapping; Strain sensor;
D O I
10.13973/j.cnki.robot.180245
中图分类号
学科分类号
摘要
This paper focuses on the inconsistency in motion spatial mapping of the master-slave fingertip caused by the inconsistent dimensions phenomenon of kinematics between human hand and robot dexterous hand. A data glove based on polyurethane strain sensors is made as data interface to measure the joint angles of the fingers. A fingertip motion trajectory calculation method and a hand gestures capturing algorithm are proposed based on rotation matrix theory and forward kinematics by establishing a master-slave kinematic model. The motion workspace boundaries of the master-slave fingertip are established by a fingertip motion mapping algorithm based on forward and inverse kinematics. A virtual experiment platform is established, and a series of experiments are performed for the joint angle mapping algorithm, the gesture motion capturing algorithm, and the fingertip motion mapping algorithm. The experiments show that the strain sensor based on polyurethane has good time response characteristic and electrical stability. The motion workspace boundaries of the master-slave fingertip are acquired based on the gesture motion capturing algorithm, and the calculation error of the fingertip motion trajectory is controlled within 2.8 mm. The results show that the combination of the hand gesture motion capturing algorithm and the fingertips motion mapping algorithm can achieve the consistency of master-slave fingertip motion space. © 2019, Science Press. All right reserved.
引用
收藏
页码:156 / 164
页数:8
相关论文
共 32 条
  • [11] Chen W.F., Zhu S.J., Wan H.G., Et al., Dual quaternion based virtual hand interaction modeling, Science China: Information Sciences, 56, 3, pp. 1-11, (2013)
  • [12] Wang K.R., Xiao B.J., Xia J.Y., Et al., A real-time vision-based hand gesture interaction system for virtual EAST, Fusion Engineering & Design, 112, pp. 829-834, (2016)
  • [13] Fang B., Guo D., Sun F.C., Et al., A robotic hand-arm teleoperation system using human arm/hand with a novel data glove, IEEE International Conference on Robotics and Biomimetics, pp. 2483-2488, (2016)
  • [14] Beecks C., Hassani M., Brenger B., Et al., Efficient query processing in 3D motion capture gesture databases, International Journal of Semantic Computing, 10, 1, pp. 5-25, (2016)
  • [15] Gong D.X., Zhao J.J., Yu J., Et al., Motion mapping of the heterogeneous master-slave system for intuitive telemanipulation, International Journal of Advanced Robotic Systems, 15, 1, (2018)
  • [16] Wei T., Xiao N.F., Control system of dexterous hand based on data glove, Computer Engineering & Design, 30, 7, pp. 1707-1711, (2009)
  • [17] Yu G., Sun Z.J., Huang W.Q., Et al., Master-slave motion mapping method for dexterous hand driven by ultrasonic motors based on time-varying coefficients, International Conference on Electronics, Communications and Control, pp. 890-893, (2011)
  • [18] Liu J., Zhang Y.R., Mapping human hand motion to dexterous robotic hand, IEEE International Conference on Robotics and Biomimetics, pp. 829-834, (2008)
  • [19] Zhao Y.P., Fei F., Yang D.H., Et al., Research on data glove for hand rehabilitation, Chinese Journal of Scientific Instrument, 38, 10, pp. 2415-2421, (2017)
  • [20] Kobayashi F., Kitabayashi K., Kai S., Et al., Human motion caption with vision and inertial sensors for hand/arm robot teleoperation, International Journal of Applied Electromagnetics & Mechanics, 52, 3, pp. 1-8, (2016)