A survey on 3D hand pose estimation: Cameras, methods, and datasets

被引:70
作者
Li, Rui [1 ]
Liu, Zhenyu [1 ]
Tan, Jianrong [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Hand pose estimation; Hand tracking; Depth camera; Human-computer interaction; REGRESSION FORESTS; KINECT; SYSTEM; SENSOR; ACCURACY; MOTION; MODEL;
D O I
10.1016/j.patcog.2019.04.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D Hand pose estimation has received an increasing amount of attention, especially since consumer depth cameras came onto the market in 2010. Although substantial progress has occurred recently, no overview has kept up with the latest developments. To bridge the gap, we provide a comprehensive survey, including depth cameras, hand pose estimation methods, and public benchmark datasets. First, a markerless approach is proposed to evaluate the tracking accuracy of depth cameras with the aid of a numerical control linear motion guide. Traditional approaches focus only on static characteristics. The evaluation of dynamic tracking capability has been long neglected. Second, we summarize the state-of-the-art methods and analyze the lines of research. Third, existing benchmark datasets and evaluation criteria are identified to provide further insight into the field of hand pose estimation. In addition, realistic challenges, recent trends, dataset creation and annotation, and open problems for future research directions are also discussed. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:251 / 272
页数:22
相关论文
共 184 条
[81]   Human hand modelling: kinematics, dynamics, applications [J].
Gustus, Agneta ;
Stillfried, Georg ;
Visser, Judith ;
Jorntell, Henrik ;
van der Smagt, Patrick .
BIOLOGICAL CYBERNETICS, 2012, 106 (11-12) :741-755
[82]  
Hansard M., 2012, SPRINGER SCI BUSINES
[83]  
Hao Liang, 2015, 2015 25th International Conference on Field Programmable Logic and Applications (FPL), P1, DOI 10.1109/FPL.2015.7293954
[84]   A Real-Time Hand Pose Estimation System with Retrieval [J].
Hou, Guangdong ;
Cui, Runpeng ;
Zhang, Changshui .
2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, :1738-1744
[85]   Hand pose estimation with multi-scale network [J].
Hu, Zhongxu ;
Hu, Youmin ;
Wu, Bo ;
Liu, Jie ;
Han, Dongmin ;
Kurfess, Thomas .
APPLIED INTELLIGENCE, 2018, 48 (08) :2501-2515
[86]  
Jakus G, 2014, LECT NOTES COMPUT SC, V8511, P254, DOI 10.1007/978-3-319-07230-2_25
[87]   3D Finger CAPE: Clicking Action and Position Estimation under Self-Occlusions in Egocentric Viewpoint [J].
Jang, Youngkyoon ;
Noh, Seung-Tak ;
Chang, Hyung Jin ;
Kim, Tae-Kyun ;
Woo, Woontack .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (04) :501-510
[88]   Hierarchical topology based hand pose estimation from a single depth image [J].
Ji, Yanli ;
Li, Haoxin ;
Yang, Yang ;
Li, Shuying .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (09) :10553-10568
[89]  
Keskin C, 2012, LECT NOTES COMPUT SC, V7577, P852, DOI 10.1007/978-3-642-33783-3_61
[90]  
Keskin C, 2011, 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS), DOI 10.1109/ICCVW.2011.6130391