Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] An accurate volume estimation on single view object images by deep learning based depth map analysis and 3D reconstruction
    Dalai, Radhamadhab
    Dalai, Nibedita
    Senapati, Kishore Kumar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (18) : 28235 - 28258
  • [32] An accurate volume estimation on single view object images by deep learning based depth map analysis and 3D reconstruction
    Radhamadhab Dalai
    Nibedita Dalai
    Kishore Kumar Senapati
    Multimedia Tools and Applications, 2023, 82 : 28235 - 28258
  • [33] HandDAGT: A Denoising Adaptive Graph Transformer for 3D Hand Pose Estimation
    Cheng, Wencan
    Kim, Eunji
    Ko, Jong Hwan
    COMPUTER VISION - ECCV 2024, PT LXXXVIII, 2025, 15146 : 35 - 52
  • [34] SARN: Shifted Attention Regression Network for 3D Hand Pose Estimation
    Zhu, Chenfei
    Hu, Boce
    Chen, Jiawei
    Ai, Xupeng
    Agrawal, Sunil K. K.
    BIOENGINEERING-BASEL, 2023, 10 (02):
  • [35] Camera distance helps 3D hand pose estimated from a single RGB image
    Cui, Yuan
    Li, Moran
    Gao, Yuan
    Gao, Changxin
    Wu, Fan
    Wen, Hao
    Li, Jiwei
    Sang, Nong
    GRAPHICAL MODELS, 2023, 127
  • [36] Differentiable Spatial Regression: A Novel Method for 3D Hand Pose Estimation
    Zhang, Xingyuan
    Zhang, Fuhai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 166 - 176
  • [37] A robust algorithm for estimation of depth map for 3D shape recovery
    Malik, Aamir Saeed
    Choi, Tae-Sun
    THREE-DIMENSIONAL IMAGE CAPTURE AND APPLICATIONS VII, 2006, 6056
  • [38] Profilometry Scaning for Correction of 3D Images Depth Map Estimation
    Kaller, Ondrej
    Bolecek, Libor
    Kratochvil, Tomas
    53RD INTERNATIONAL SYMPOSIUM ELMAR-2011, 2011, : 119 - 122
  • [39] 3D hand pose and shape estimation from RGB images for keypoint-based hand gesture recognition
    Avola, Danilo
    Cinque, Luigi
    Fagioli, Alessio
    Foresti, Gian Luca
    Fragomeni, Adriano
    Pannone, Daniele
    PATTERN RECOGNITION, 2022, 129
  • [40] Supervised High-Dimension Endecoder Net: 3D End to End Prediction Network for Mark-less Human Pose Estimation from Single Depth Map
    Shen, Li
    Chen, Ying
    CONFERENCE PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2019, : 856 - 860