Desktop Gestures Recognition for Human Computer Interaction

被引:1
作者
Zhu, Qingjie [1 ,2 ,6 ]
Pan, Hang [3 ,4 ,6 ]
Yang, Minghao [6 ]
Zhan, Yongsong [5 ]
机构
[1] Guilin Univ Elect Technol, Guangxi Key Lab Trusted Software, Guilin 541004, Guangxi, Peoples R China
[2] Guilin Univ Elect Technol, Guangxi Cooperat Innovat Ctr Cloud Comp & Big Dat, Guilin 541004, Guangxi, Peoples R China
[3] Guilin Univ Elect Technol, Guangxi Key Lab Cryptog & Informat Secur, Guilin 541004, Guangxi, Peoples R China
[4] Guilin Univ Elect Technol, Guangxi Coll & Univ Key Lab Intelligent Proc Comp, Guilin 541004, Guangxi, Peoples R China
[5] Guilin Univ Elect Technol, Key Lab Cloud Comp & Complex Syst, Guilin 541004, Guangxi, Peoples R China
[6] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
来源
ADVANCES IN SWARM INTELLIGENCE, ICSI 2017, PT II | 2017年 / 10386卷
关键词
Gesture recognition; Human-computer interaction; Computer vision;
D O I
10.1007/978-3-319-61833-3_61
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A dynamic gesture recognition and understanding method in natural human-computer interaction under desktop environment is proposed, including the "reach", "take up", "move", "put down", "return", "point" and other natural interactive gestures. In preprocess procedure of each frame of the video, the Gaussian background model and HSV skin-color model is employed to remove background and segment hand gestures. The temporal and spatial information of multi frame images is combined to construct temporal and spatial features of dynamic gestures images. Then a convolution neural network is built for recognize the dynamic characteristics of gesture image. Finally, the classification result is denoised to achieve the robust recognition and understanding of gestures. Experimental results show that the proposed method has a good ability of recognizing and understanding the dynamic gestures in the desktop environment.
引用
收藏
页码:578 / 585
页数:8
相关论文
共 7 条
[1]   Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis [J].
Garcia, Christophe ;
Tziritas, Georgios .
IEEE TRANSACTIONS ON MULTIMEDIA, 1999, 1 (03) :264-277
[2]   3D Convolutional Neural Networks for Human Action Recognition [J].
Ji, Shuiwang ;
Xu, Wei ;
Yang, Ming ;
Yu, Kai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :221-231
[3]  
Kang Xiao-jing, 2010, Chinese Journal of Liquid Crystals and Displays, V25, P454
[4]  
Sternberg M.L. A., 1981, AM SIGN LANGUAGE COM
[5]  
Sturman D. J, 1989, ACM SIGGERAPH S US I
[6]  
Sural S, 2002, 2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, P589
[7]  
Vamplew P, 1999, P IEEE INT C NEUR NE, V6, P1226