Gesture-based system for next generation natural and intuitive interfaces

被引:12
作者
Huang, Jinmiao [1 ]
Jaiswal, Prakhar [2 ]
Rai, Rahul [2 ]
机构
[1] ABB Inc, Bloomfield, CT USA
[2] SUNY Buffalo, MADLab, Buffalo, NY 14260 USA
来源
AI EDAM-ARTIFICIAL INTELLIGENCE FOR ENGINEERING DESIGN ANALYSIS AND MANUFACTURING | 2019年 / 33卷 / 01期
关键词
CAD modeling; depth-sensing cameras; gesture recognition; user interfaces; RECOGNITION; ONLINE; TRACKING;
D O I
10.1017/S0890060418000045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel and trainable gesture-based system for next-generation intelligent interfaces. The system requires a non-contact depth sensing device such as an RGB-D (color and depth) camera for user input. The camera records the user's static hand pose and palm center dynamic motion trajectory. Both static pose and dynamic trajectory are used independently to provide commands to the interface. The sketches/symbols formed by palm center trajectory is recognized by the Support Vector Machine classifier. Sketch/symbol recognition process is based on a set of geometrical and statistical features. Static hand pose recognizer is incorporated to expand the functionalities of our system. Static hand pose recognizer is used in conjunction with sketch classification algorithm to develop a robust and effective system for natural and intuitive interaction. To evaluate the performance of the system user studies were performed on multiple participants. The efficacy of the presented system is demonstrated using multiple interfaces developed for different tasks including computer-aided design modeling.
引用
收藏
页码:54 / 68
页数:15
相关论文
共 61 条
[41]  
Oikonomidis I., 2011, BMVC, V1, P3
[42]   Shape distributions [J].
Osada, R ;
Funkhouser, T ;
Chazelle, B ;
Dobkin, D .
ACM TRANSACTIONS ON GRAPHICS, 2002, 21 (04) :807-832
[43]   AUTOMATIC BEAUTIFIER FOR DRAWINGS AND ILLUSTRATIONS. [J].
Pavlidis, Theo ;
Van Wyk, Christopher J. .
Computer Graphics (ACM), 1985, 19 (03) :225-234
[44]   Visual interpretation of hand gestures for human-computer interaction: A review [J].
Pavlovic, VI ;
Sharma, R ;
Huang, TS .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :677-695
[45]   On-line and off-line handwriting recognition: A comprehensive survey [J].
Plamondon, R ;
Srihari, SN .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (01) :63-84
[46]  
Press WH, 1992, NUMERICAL RECIPES EX
[47]  
Ren Z., 2011, P ACM INT C MULT MM, P1093
[48]   Robust Part-Based Hand Gesture Recognition Using Kinect Sensor [J].
Ren, Zhou ;
Yuan, Junsong ;
Meng, Jingjing ;
Zhang, Zhengyou .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (05) :1110-1120
[49]   Ensemble-based classifiers [J].
Rokach, Lior .
ARTIFICIAL INTELLIGENCE REVIEW, 2010, 33 (1-2) :1-39
[50]  
RUBINE D, 1991, COMP GRAPH, V25, P329, DOI 10.1145/127719.122753