Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] 3D CNN HAND POSE ESTIMATION WITH END-TO-END HIERARCHICAL MODEL AND PHYSICAL CONSTRAINTS FROM DEPTH IMAGES
    Xu, Z. Z.
    Zhang, W. J.
    NEURAL NETWORK WORLD, 2023, 33 (01) : 35 - 48
  • [22] 3D Hand Pose Estimation From Monocular RGB With Feature Interaction Module
    Guo, Shaoxiang
    Rigall, Eric
    Ju, Yakun
    Dong, Junyu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5293 - 5306
  • [23] A Normalization Strategy for Weakly Supervised 3D Hand Pose Estimation
    Guo, Zizhao
    Li, Jinkai
    Tan, Jiyong
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [24] mmHand: 3D Hand Pose Estimation Leveraging mmWave Signals
    Kong, Hao
    Lyu, Haoxin
    Yu, Jiadi
    Kong, Linghe
    Yang, Junlin
    Ren, Yanzhi
    Liu, Hongbo
    Chen, Yi-Chao
    2024 IEEE 44TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS 2024, 2024, : 1062 - 1073
  • [25] 3D hand pose estimation from a single RGB image through semantic decomposition of VAE latent space
    Xinru Guo
    Song Xu
    Xiangbo Lin
    Yi Sun
    Xiaohong Ma
    Pattern Analysis and Applications, 2022, 25 : 157 - 167
  • [26] Mobile robot control using 3D hand pose estimation
    Hoshino, Kiyoshi
    Kasahara, Takuya
    Igo, Naoki
    Tomida, Motomasa
    Tanimoto, Takanobu
    Mukai, Toshimitsu
    Brossard, Gilles
    Kotani, Hajime
    TENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2011, 8000
  • [27] 3D hand pose estimation from a single RGB image through semantic decomposition of VAE latent space
    Guo, Xinru
    Xu, Song
    Lin, Xiangbo
    Sun, Yi
    Ma, Xiaohong
    PATTERN ANALYSIS AND APPLICATIONS, 2022, 25 (01) : 157 - 167
  • [28] SEMI-SUPERVISED LEARNING OF MONOCULAR 3D HAND POSE ESTIMATION FROM MULTI-VIEW IMAGES
    Mueller, Markus
    Poier, Georg
    Possegger, Horst
    Bischof, Horst
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1104 - 1108
  • [29] Improvements in 3D Hand Pose Estimation Using Synthetic Data
    Kanis, Jakub
    Ryumin, Dmitry
    Krnoul, Zdenek
    INTERACTIVE COLLABORATIVE ROBOTICS, ICR 2018, 2018, 11097 : 105 - 115
  • [30] A survey on 3D hand pose estimation: Cameras, methods, and datasets
    Li, Rui
    Liu, Zhenyu
    Tan, Jianrong
    PATTERN RECOGNITION, 2019, 93 : 251 - 272