3D hand reconstruction from a single image based on biomechanical constraints

被引:10
作者
Li, Guiqing [1 ]
Wu, Zihui [1 ]
Liu, Yuxin [1 ]
Zhang, Huiqian [1 ]
Nie, Yongwei [1 ]
Mao, Aihua [1 ]
机构
[1] South China Univ Technol, Guangzhou, Peoples R China
关键词
3D hand motion reconstruction; Biomechanical constraints; Block coordinate descent; MANO parameterization; TRACKING; POSE;
D O I
10.1007/s00371-021-02250-y
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper investigates the estimate of motion parameters from 3D hand joint positions. We formulate the issue as an inverse kinematics problem with biomechanical constraints and propose a fast and robust iterative approach to address the constrained optimization. It elaborately designs a coordinate descent algorithm to decompose the problem into a sequence of decisions on the transformation around each kinematic node (i.e., joint), while the decision for each node is equivalent to a point matching problem. Addressing the whole optimization then amounts to considering all nodes of the kinematic tree from its root to leaves one by one. This not only accelerates the process but also improves the accuracy of the solution of the inverse kinematic optimization. Experiments show that our approach is able to yield results comparable to and even better than those by the state-of-the-art methods.
引用
收藏
页码:2699 / 2711
页数:13
相关论文
共 57 条
[1]   Hand pose estimation and tracking in real and virtual interaction: A review [J].
Ahmad, Ammar ;
Migniot, Cyrille ;
Dipanda, Albert .
IMAGE AND VISION COMPUTING, 2019, 89 :35-49
[2]  
[Anonymous], 2013, P ACM SIGGRAPH S INT, DOI DOI 10.1145/2448196.2448232
[3]  
[Anonymous], 2009, 2009 9 IEEE RAS INT
[4]  
[Anonymous], 2012, P ACM SIGGRAPHEUROGR, DOI [10.2312/SCA/SCA12/033-042, DOI 10.2312/SCA/SCA12/033-042]
[5]   Hand tracking with physiological constraints [J].
Aristidou, Andreas .
VISUAL COMPUTER, 2018, 34 (02) :213-228
[6]  
Athitsos V, 2003, PROC CVPR IEEE, P432
[7]   3D Hand Shape and Pose from Images in the Wild [J].
Boukhayma, Adnane ;
de Bem, Rodrigo ;
Torr, Philip H. S. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10835-10844
[8]  
Bray M., 2004, PROC INT C ARTIFICIA, P59
[9]   Geometric Deep Learning Going beyond Euclidean data [J].
Bronstein, Michael M. ;
Bruna, Joan ;
LeCun, Yann ;
Szlam, Arthur ;
Vandergheynst, Pierre .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) :18-42
[10]   Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose [J].
Choi, Hongsuk ;
Moon, Gyeongsik ;
Lee, Kyoung Mu .
COMPUTER VISION - ECCV 2020, PT VII, 2020, 12352 :769-787