Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] 3D Hand Pose Estimation from Single Depth Images with Label Distribution Learning
    Xu, Yuanfei
    Wang, Xupeng
    2020 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS), 2020,
  • [2] Learning the Dynamic Spatio-Temporal Relationship Between Joints for 3D Human Pose Estimation
    Xu, Feiyi
    Sun, Ying
    Qi, Jin
    Sun, Yanfei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 269 - 284
  • [3] 3D human pose estimation by depth map
    Wu, Jianzhai
    Hu, Dewen
    Xiang, Fengtao
    Yuan, Xingsheng
    Su, Jiongming
    VISUAL COMPUTER, 2020, 36 (07): : 1401 - 1410
  • [4] 3D human pose estimation by depth map
    Jianzhai Wu
    Dewen Hu
    Fengtao Xiang
    Xingsheng Yuan
    Jiongming Su
    The Visual Computer, 2020, 36 : 1401 - 1410
  • [5] HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map
    Malik, Jameel
    Abdelaziz, Ibrahim
    Elhayek, Ahmed
    Shimada, Soshi
    Ali, Sk Aziz
    Golyanik, Vladislav
    Theobalt, Christian
    Stricker, Didier
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7111 - 7120
  • [6] 3D Hand Pose Estimation from RGB Using Privileged Learning with Depth Data
    Yuan, Shanxin
    Stenger, Bjorn
    Kim, Tae-Kyun
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2866 - 2873
  • [7] HMTNet: 3D Hand Pose Estimation From Single Depth Image Based on Hand Morphological Topology
    Zhou, Weiguo
    Jiang, Xin
    Chen, Chen
    Mei, Sijia
    Liu, Yun-Hui
    IEEE SENSORS JOURNAL, 2020, 20 (11) : 6004 - 6011
  • [8] Simultaneous 3D hand detection and pose estimation using single depth images
    Zhang, Yu
    Mi, Siya
    Wu, Jianxin
    Geng, Xin
    PATTERN RECOGNITION LETTERS, 2020, 140 (140) : 43 - 48
  • [9] Hand Shape and 3D Pose Estimation Using Depth Data from a Single Cluttered Frame
    Doliotis, Paul
    Athitsos, Vassilis
    Kosmopoulos, Dimitrios
    Perantonis, Stavros
    ADVANCES IN VISUAL COMPUTING, ISVC 2012, PT I, 2012, 7431 : 148 - 158
  • [10] Accurate 3D Pose Estimation From a Single Depth Image
    Ye, Mao
    Wang, Xianwang
    Yang, Ruigang
    Ren, Liu
    Pollefeys, Marc
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 731 - 738