Sensor Design for Hand Gesture Capturing and Master-Slave Hand Motion Mapping

被引:0
|
作者
Zhang Y. [1 ]
Huang Y. [1 ]
Liu J. [1 ]
Liu P. [1 ]
Zhang Y. [1 ]
机构
[1] School of Electronic Science & Applied Physics, Hefei University of Technology, Hefei
来源
Jiqiren/Robot | 2019年 / 41卷 / 02期
关键词
Hand gesture capturing; Kinematics; Master-slave hand; Motion mapping; Strain sensor;
D O I
10.13973/j.cnki.robot.180245
中图分类号
学科分类号
摘要
This paper focuses on the inconsistency in motion spatial mapping of the master-slave fingertip caused by the inconsistent dimensions phenomenon of kinematics between human hand and robot dexterous hand. A data glove based on polyurethane strain sensors is made as data interface to measure the joint angles of the fingers. A fingertip motion trajectory calculation method and a hand gestures capturing algorithm are proposed based on rotation matrix theory and forward kinematics by establishing a master-slave kinematic model. The motion workspace boundaries of the master-slave fingertip are established by a fingertip motion mapping algorithm based on forward and inverse kinematics. A virtual experiment platform is established, and a series of experiments are performed for the joint angle mapping algorithm, the gesture motion capturing algorithm, and the fingertip motion mapping algorithm. The experiments show that the strain sensor based on polyurethane has good time response characteristic and electrical stability. The motion workspace boundaries of the master-slave fingertip are acquired based on the gesture motion capturing algorithm, and the calculation error of the fingertip motion trajectory is controlled within 2.8 mm. The results show that the combination of the hand gesture motion capturing algorithm and the fingertips motion mapping algorithm can achieve the consistency of master-slave fingertip motion space. © 2019, Science Press. All right reserved.
引用
收藏
页码:156 / 164
页数:8
相关论文
共 32 条
  • [1] Xu Z.Q., Li H.D., He J.L., A novel medical human-computer interaction platform based on Kinect depth image analysis refactoring and neural network, International Journal of Biomedical Engineering Technology, 23, 2-4, pp. 315-334, (2017)
  • [2] Li P., Construction and simulation on intelligent medical equipment system based on virtual reality technology and human-computer interaction model, International Journal of Biomedical Engineering Technology, 23, 2-4, pp. 261-280, (2017)
  • [3] Qin C.L., Song A.G., Wu C.C., Et al., Scenario interaction system of rehabilitation training robot based on Unity3D and Kinect, Chinese Journal of Scientific Instrument, 38, 3, pp. 530-536, (2017)
  • [4] Robins B., Dautenhahn K., Ferrari E., Et al., Scenarios of robotassisted play for children with cognitive and physical disabilities, Interaction Studies, 13, 2, pp. 189-199, (2012)
  • [5] Yoshida K., Yamada H., Kato R., Et al., Development of five-finger robotic hand using master-slave control for hand-assisted laparoscopic surgery, 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (2016)
  • [6] Chen Y.M., Zhang Y.H., Research on human-robot interaction technique based on hand gesture recognition, Robot, 31, 4, pp. 351-356, (2009)
  • [7] Wen G.H., Wan Y., Cao J., Et al., Master-slave synchronization of heterogeneous systems under scheduling communication, IEEE Transactions on Systems, Man, and Cybernetics: Systems, 48, 3, pp. 473-484, (2018)
  • [8] Ferrone A., Maita F., Maiolo L., Et al., Wearable band for hand gesture recognition based on strain sensors, IEEE International Conference on Biomedical Robotics and Biomechatronics, pp. 1319-1322, (2016)
  • [9] Qi J., Xu K., Ding X.L., Vision-based hand gesture recognition for human-robot interaction: A review, Robot, 39, 4, pp. 565-584, (2017)
  • [10] Dipietro L., Sabatini A.M., Dario P., A survey of glove-based systems and their applications, IEEE Transactions on Systems, Man, and Cybernetics, Part C, 38, 4, pp. 461-482, (2008)