Computer vision-based hand gesture recognition for human-robot interaction: a review

被引:42
作者
Qi, Jing [1 ,2 ]
Ma, Li [1 ,2 ]
Cui, Zhenchao [1 ,2 ]
Yu, Yushu [3 ]
机构
[1] Hebei Univ, Sch Cyber Secur & Comp, Qiyi East Rd, Baoding 071002, Hebei, Peoples R China
[2] Hebei Univ, Machine Vis Engn Res Ctr Hebei Prov, Qiyi East Rd, Baoding 071002, Hebei, Peoples R China
[3] Beijing Inst Technol, Sch Mechatron Engn, Zhongguancun South St, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Hand gesture recognition; RGB-D camera; Human-robot interaction; Robot; PETROGRAPHIC IMAGES; EDGE-DETECTION; SEGMENTATION;
D O I
10.1007/s40747-023-01173-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As robots have become more pervasive in our daily life, natural human-robot interaction (HRI) has had a positive impact on the development of robotics. Thus, there has been growing interest in the development of vision-based hand gesture recognition for HRI to bridge human-robot barriers. The aim is for interaction with robots to be as natural as that between individuals. Accordingly, incorporating hand gestures in HRI is a significant research area. Hand gestures can provide natural, intuitive, and creative methods for communicating with robots. This paper provides an analysis of hand gesture recognition using both monocular cameras and RGB-D cameras for this purpose. Specifically, the main process of visual gesture recognition includes data acquisition, hand gesture detection and segmentation, feature extraction and gesture classification, which are discussed in this paper. Experimental evaluations are also reviewed. Furthermore, algorithms of hand gesture recognition for human-robot interaction are examined in this study. In addition, the advances required for improvement in the present hand gesture recognition systems, which can be applied for effective and efficient human-robot interaction, are discussed.
引用
收藏
页码:1581 / 1606
页数:26
相关论文
共 219 条
  • [1] Ahmed AA, 2014, I C ENG TECHNOL
  • [2] Ahmed W, 2016, PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE (ICIS), P120, DOI 10.1109/INFOSCI.2016.7845312
  • [3] Ahuja MK, 2015, 2015 IEEE 3RD INTERNATIONAL CONFERENCE ON MOOCS, INNOVATION AND TECHNOLOGY IN EDUCATION (MITE), P402, DOI 10.1109/MITE.2015.7375353
  • [4] Akmeliawati R., 2009, 2009 IEEE Instrumentation and Measurement Technology Conference (I2MTC), P1200, DOI 10.1109/IMTC.2009.5168637
  • [5] Hand Gesture Recognition for Sign Language Using 3DCNN
    Al-Hammadi, Muneer
    Muhammad, Ghulam
    Abdul, Wadood
    Alsulaiman, Mansour
    Bencherif, Mohamed A.
    Mekhtiche, Mohamed Amine
    [J]. IEEE ACCESS, 2020, 8 : 79491 - 79509
  • [6] AlFarid F, 2019, SPIE, V11049, P265
  • [7] Allen JG, 2004, OBJECT TRACKING USIN
  • [8] Enhance Robotics ability in Hand Gesture Recognition by Using Leap Motion Controller
    Almarzuqi, Alaa Ahmed
    Buhari, Seyed Mohamed
    [J]. ADVANCES ON BROAD-BAND WIRELESS COMPUTING, COMMUNICATION AND APPLICATIONS, 2017, 2 : 513 - 523
  • [9] Feature extraction in Brazilian Sign Language Recognition based on phonological structure and using RGB-D sensors
    Almeida, Silvia Grasiella Moreira
    Guimaraes, Frederico Gadelha
    Ramirez, Jaime Arturo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (16) : 7259 - 7271
  • [10] Safe Driving using Vision-based Hand Gesture Recognition System in Non-uniform Illumination Conditions
    Anant, Shalini
    Veni, Shanmugham
    [J]. JOURNAL OF ICT RESEARCH AND APPLICATIONS, 2018, 12 (02) : 154 - 167