Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] HBE: Hand Branch Ensemble Network for Real-Time 3D Hand Pose Estimation
    Zhou, Yidan
    Lu, Jian
    Du, Kuo
    Lin, Xiangbo
    Sun, Yi
    Ma, Xiaohong
    COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 521 - 536
  • [42] CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Prompting
    Guo, Shaoxiang
    Cai, Qing
    Qi, Lin
    Dong, Junyu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4896 - 4907
  • [43] 3D hand pose estimation and reconstruction based on multi-feature fusion
    Wang, Jiye
    Xiang, Xuezhi
    Ding, Shuai
    El Saddik, Abdulmotaleb
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 101
  • [44] 3D Hand Pose Estimation Based on Double Branches with Multi Scale Attention
    Ma S.-L.
    Li J.-H.
    Kong D.-H.
    Wang L.-C.
    Wang S.-F.
    Yin B.-C.
    Jisuanji Xuebao/Chinese Journal of Computers, 2023, 46 (07): : 1383 - 1395
  • [45] An end-to-end framework for unconstrained monocular 3D hand pose estimation
    Sharma, Sanjeev
    Huang, Shaoli
    PATTERN RECOGNITION, 2021, 115
  • [46] Monocular 3D hand pose estimation based on high-resolution network
    Shengling Li
    Wanjuan Su
    Guansheng Luo
    Jinshan Tian
    Yifei Han
    Liman Liu
    Wenbing Tao
    Advances in Continuous and Discrete Models, 2025 (1):
  • [47] Weakly Supervised Adversarial Learning for 3D Human Pose Estimation from Point Clouds
    Zhang, Zihao
    Hu, Lei
    Deng, Xiaoming
    Xia, Shihong
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (05) : 1851 - 1859
  • [48] Combining Defocus and Photoconsistency for Depth Map Estimation in 3D Integral Imaging
    Espinos-Morato, H.
    Latorre-Carmona, P.
    Martinez Sotoca, J.
    Pla, F.
    Javidi, B.
    PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2017), 2017, 10255 : 114 - 121
  • [49] FingerPoseNet: A finger-level multitask learning network with residual feature sharing for 3D hand pose estimation
    Tewolde, Tekie Tsegay
    Manjotho, Ali Asghar
    Sarker, Prodip Kumar
    Niu, Zhendong
    NEURAL NETWORKS, 2025, 187
  • [50] Region ensemble network: Towards good practices for deep 3D hand pose estimation
    Wang, Guijin
    Chen, Xinghao
    Guo, Hengkai
    Zhang, Cairong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 55 : 404 - 414