Visual Gesture Recognition for Human Robot Interaction Using Dynamic Movement Primitives

被引:0
|
作者
Liu, Zhan [1 ]
Hu, Fan [1 ]
Luo, Dingsheng [1 ]
Wu, Xihong [1 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Speech & Hearing Res Ctr, Key Lab Machine Percept,Minist Educ, Beijing 100871, Peoples R China
关键词
Gesture recognition; human robot interaction; dynamic movement primitives;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper a method to address the efficiency and robustness of dynamic hand gesture recognition for human robot interaction is proposed. By using on-board monocular camera and specialized gesture detection algorithms, the humanoid robot is able to detect gestures fast. To model the dynamics of gestures, the dynamic movement primitives (DMP) model is employed, which well characterizes both spatial and temporal evolutions of gestures. The invariance properties of the DMP model against different spatiotemporal scales also offer expected robustness to handle the variances in gestures. To cope with the diversity and noise of gestures, an efficient adaptive DMP learning method is further proposed. Since the learnt weights of the DMP compactly represent the original gestures, they serve as ideal feature vectors for building a classifier to recognize new gestures. To evaluate the proposed method, a nine-class human gestures recognition task on a real humanoid robot is performed and 98.06% accuracy is obtained. Experimental results demonstrate the effectiveness of our method.
引用
收藏
页码:2094 / 2100
页数:7
相关论文
共 50 条
  • [41] FGDSNet: A Lightweight Hand Gesture Recognition Network for Human Robot Interaction
    Zhou, Guoyu
    Cui, Zhenchao
    Qi, Jing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04): : 3076 - 3083
  • [42] Real-Time Hand Gesture Recognition for Human Robot Interaction
    Correa, Mauricio
    Ruiz-del-Solar, Javier
    Verschae, Rodrigo
    Lee-Ferny, Jong
    Castillo, Nelson
    ROBOCUP 2009: ROBOT SOCCER WORLD CUP XIII, 2010, 5949 : 46 - 57
  • [43] Gesture recognition based on arm tracking for human-robot interaction
    Sigalas, Markos
    Baltzakis, Haris
    Trahanias, Panos
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 5424 - 5429
  • [44] Human robot interaction for manipulation tasks based on stroke gesture recognition
    Li, Jiajun
    Tao, Jianguo
    Ding, Liang
    Gao, Haibo
    Deng, Zongquan
    Luo, Yang
    Li, Zhandong
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2017, 44 (06): : 700 - 710
  • [45] Gesture recognition based on context awareness for human-robot interaction
    Hong, Seok-Ju
    Setiawan, Nurul Arif
    Kim, Song-Gook
    Lee, Chil-Woo
    ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 1 - +
  • [46] Face tracking and hand gesture recognition for human-robot interaction
    Brèthes, L
    Menezes, P
    Lerasle, F
    Hayet, J
    2004 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1- 5, PROCEEDINGS, 2004, : 1901 - 1906
  • [47] Feature Selection for Hand Gesture Recognition in Human-Robot Interaction
    McCarver, Matthew
    Qin, Jing
    Xie, Biyun
    2024 33RD IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, ROMAN 2024, 2024, : 1222 - 1227
  • [48] HRI-Gestures: Gesture Recognition for Human-Robot Interaction
    Kollakidou, Avgi
    Haarslev, Frederik
    Odabasi, Cagatay
    Bodenhagen, Leon
    Krueger, Norbert
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, : 559 - 566
  • [49] Dynamic Movement Primitives Based Robot Skills Learning
    Kong, Ling-Huan
    He, Wei
    Chen, Wen-Shi
    Zhang, Hui
    Wang, Yao-Nan
    MACHINE INTELLIGENCE RESEARCH, 2023, 20 (03) : 396 - 407
  • [50] The Generalization of Robot Skills Based on Dynamic Movement Primitives
    Li, Xian
    Yang, Chenguang
    Feng, Ying
    IFAC PAPERSONLINE, 2020, 53 (05): : 265 - 270