An intelligent perception and gesture recognition technology for wearable piano-playing glove

被引：0
作者：
Ye S. [1 ,2 ]
Lai J. [1 ,2 ]
Lyu P. [1 ,2 ]
Zhu C. [1 ,2 ]
机构：
[1] College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing
[2] Jiangsu University Key Laboratory of Internet of Things and Control Technology, Nanjing
来源：
Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument | 2019年 / 40卷 / 05期
关键词：
Gesture recognition; Hierarchical recognition; Inertial data gloves; Machine learning; Multimodal features;
D O I：
10.19650/j.cnki.cjsi.J1904759
中图分类号：
学科分类号：
摘要：
Piano-playing glove is one kind of emerging intelligent wearable equipment. By using the multi-inertial sensors in glove, the gesture of piano player can be real-time perceived and analyzed. The learners can know in real-time whether the playing gesture is right. Thus, the efficiency and interest of piano learning can be improved and the cost of learning can be reduced effectively. Different from gestures in other application fields, piano playing gestures have the characteristics of diversity, rapidity, large dynamics and strong time-varying. In this study, the piano playing gesture recognition system based on inertial data glove and infrared detecting rod is designed. A method of gesture recognition for piano playing based on machine learning is proposed. The output of inertia data gloves and infrared detection rods are used as data sample. According to the characteristics of piano playing gestures, multi-modal gesture features are extracted. Hierarchical recognition algorithm is adopted to improve the recognition effectiveness. Experimental results show that the proposed recognition method can better meet the needs of gesture recognition in piano playing. The recognition accuracy rate is better than 99%. © 2019, Science Press. All right reserved.
引用
收藏
页码：187 / 194
页数：7
相关论文
共 17 条
  • [1] Berman S., Stern H., Sensors for gesture recognition systems, IEEE Transactions on Systems Man & Cybernetics Part C, 42, 3, pp. 277-290, (2012)
  • [2] Fang B., Sun F.C., Liu H.P., Et al., 3D human gesture capturing and recognition by the IMMU-based data glove, Neurocomputing, 277, pp. 198-207, (2018)
  • [3] Saddiqiu N., Chan R.H.M., A Wearable hand gesture recognition device based on acoustic measurements at wrist, (2017)
  • [4] Kalpattu S.A., Lee C.F.Q., Derek H., Glove-based hand gesture recognition sign language translator using capacitive touch sensor, IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC), (2016)
  • [5] Cavallo F., Esposito D., Rovini E., Et al., Preliminary evaluation of sens hand V1 in assessing motor skills performance in parkinson disease, IEEE 13th International Conference on Rehabilitation Robotics, pp. 1-6, (2013)
  • [6] Santos L., Carbonaro N., Tobnetti A., Et al., Dynamic gesture recognition using a smart glove in hand-assisted laparoscopic surgery, Technologies, 6, 1, (2018)
  • [7] Kong D.R., Zhu J., Gesture recognition based on fusion of surface electromyography and acceleration information, Electronic Measurement Technology, 42, 5, pp. 85-89, (2019)
  • [8] Yin S., Yang J., Qu Y., Et al., Research on gesture recognition technology of data glove based on joint algorithm, 2nd International Conference on Mechanical, Electronic, Control and Automation Engineering, (2018)
  • [9] Sun Q., Gonzalez E., Abadines B., A wearable sensor based hand movement rehabilitation and evaluation system, 11th International Conference on Sensing Technology, (2017)
  • [10] Akiya O., Manabu H., Marker-less piano fingering recognition using sequential depth images, 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, (2013)
12