Real-time sign language recognition using a consumer depth camera

被引:77
作者
Kuznetsova, Alina [1 ]
Leal-Taixe, Laura [1 ]
Rosenhahn, Bodo [1 ]
机构
[1] Leibniz Univ Hannover, Inst Informat Verarbeitung, D-30167 Hannover, Germany
来源
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW) | 2013年
关键词
D O I
10.1109/ICCVW.2013.18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gesture recognition remains a very challenging task in the field of computer vision and human computer interaction (HCI). A decade ago the task seemed to be almost un-solvable with the data provided by a single RGB camera. Due to recent advances in sensing technologies, such as time-of-flight and structured light cameras, there are new data sources available, which make hand gesture recognition more feasible. In this work, we propose a highly precise method to recognize static gestures from a depth data, provided from one of the above mentioned devices. The depth images are used to derive rotation-, translation-and scale-invariant features. A multi-layered random forest (MLRF) is then trained to classify the feature vectors, which yields to the recognition of the hand signs. The training time and memory required by MLRF are much smaller, compared to a simple random forest with equivalent precision. This allows to repeat the training procedure of MLRF without significant effort. To show the advantages of our technique, we evaluate our algorithm on synthetic data, on publicly available dataset, containing 24 signs from American Sign Language( ASL) and on a new dataset, collected using recently appeared Intel Creative Gesture Camera.
引用
收藏
页码:83 / 90
页数:8
相关论文
共 21 条
  • [1] Shape quantization and recognition with randomized trees
    Amit, Y
    Geman, D
    [J]. NEURAL COMPUTATION, 1997, 9 (07) : 1545 - 1588
  • [2] [Anonymous], MACHINE LEARNING MAT
  • [3] [Anonymous], P 9 INT S VIS COMP I
  • [4] [Anonymous], 2013, P 2 INT C PATTERN RE
  • [5] [Anonymous], P IEEE WORKSH APPL C
  • [6] [Anonymous], 2012, WORKSH COL DEPTH CAM
  • [7] [Anonymous], ICCV WORKSH
  • [8] Ballan L, 2012, LECT NOTES COMPUT SC, V7577, P640, DOI 10.1007/978-3-642-33783-3_46
  • [9] Random forests
    Breiman, L
    [J]. MACHINE LEARNING, 2001, 45 (01) : 5 - 32
  • [10] Dardas N. H., 2011, COMPUTATIONAL INTELL, P1