Learning dynamic relationship between joints for 3D hand pose estimation from single depth map

被引:1
|
作者
Xing, Huiqin [1 ]
Yang, Jianyu [1 ]
Xiao, Yang [2 ]
机构
[1] Soochow Univ, Sch Rail Transportat, 8 Jixue Rd, Suzhou 215131, Jiangsu, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430000, Hubei, Peoples R China
关键词
Hand pose estimation; Dynamic anchor; Hand gesture; Depth map;
D O I
10.1016/j.jvcir.2023.103803
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D hand pose estimation from a single depth map is an essential topic in computer vision. Most existing methods are devoted to designing a model to capture more spatial information or designing loss functions based on prior knowledge to constrain the estimated pose with prior spatial information. In this work, we focus on constraining the estimation process with spatial information adaptively by learning the mutual position relationship between joint pairs. Specifically, we propose a dynamic relationship network (DRN) with dynamic anchors. The preset fixed anchors are employed to estimate the position of each joint initially. Then, each joint is considered a dynamic anchor, which plays the role of a dynamic regressor to adjust the initially estimated position of each joint. The final estimation of each joint is the weighted sum of the results from all the dynamic anchors. Extensive experiments on benchmarks demonstrate that our method provides competitive results compared with state-of-the-arts.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Accurate 3D hand pose estimation network utilizing joints information
    Zhang, Xiongquan
    Huang, Shiliang
    Ye, Zhongfu
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 90
  • [2] Multi-virtual View Scoring Network for 3D Hand Pose Estimation from a Single Depth Image
    Tian, Yimeng
    Li, Chen
    Tian, Lihua
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2023, 2024, 1998 : 147 - 164
  • [3] Hierarchically constrained 3D hand pose estimation using regression forests from single frame depth data
    Kirac, Furkan
    Kara, Yunus Emre
    Akarun, Lale
    PATTERN RECOGNITION LETTERS, 2014, 50 : 91 - 100
  • [4] Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey
    Ohkawa, Takehiko
    Furuta, Ryosuke
    Sato, Yoichi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (12) : 3193 - 3206
  • [5] Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey
    Takehiko Ohkawa
    Ryosuke Furuta
    Yoichi Sato
    International Journal of Computer Vision, 2023, 131 : 3193 - 3206
  • [6] An Improved Approach for 3D Hand Pose Estimation Based on a Single Depth Image and Haar Random Forest
    Kim, Wonggi
    Chun, Junchul
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2015, 9 (08): : 3136 - 3150
  • [7] Lightweight 3D hand pose estimation by cascading CNNs with reinforcement learning
    Chen, Mingqi
    Li, Shaodong
    Shuang, Feng
    Liu, Xi
    Luo, Kai
    He, Wenbo
    PATTERN RECOGNITION LETTERS, 2023, 174 : 137 - 144
  • [8] 3D Hand Pose Estimation with Neural Networks
    Antonio Serra, Jose
    Garcia-Rodriguez, Jose
    Orts-Escolano, Sergio
    Manuel Garcia-Chamizo, Juan
    Angelopoulou, Anastassia
    Psarrou, Alexandra
    Mentzelopoulos, Markos
    Montoyo-Bojo, Javier
    Dominguez, Enrique
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, PT II, 2013, 7903 : 504 - +
  • [9] 3D Capsule Hand Pose Estimation Network Based on Structural Relationship Information
    Wu, Yiqi
    Ma, Shichao
    Zhang, Dejun
    Sun, Jun
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 14
  • [10] Learning a deep network with spherical part model for 3D hand pose estimation
    Chen, Tzu-Yang
    Ting, Pai-Wen
    Wu, Min-Yu
    Fu, Li-Chen
    PATTERN RECOGNITION, 2018, 80 : 1 - 20