Coot optimization based Enhanced Global Pyramid Network for 3D hand pose estimation

被引:0
|
作者
Malavath, Pallavi [1 ]
Devarakonda, Nagaraju [1 ]
机构
[1] VIT AP Univ AP Univ, Sch Comp Sci & Engn, Amaravati, India
来源
MACHINE LEARNING-SCIENCE AND TECHNOLOGY | 2022年 / 3卷 / 04期
关键词
hand pose estimation; Enhanced Global Pyramid Network; DetNet; pose correction network; Coot optimization and sign language;
D O I
10.1088/2632-2153/ac9fa5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to its importance in various applications that need human-computer interaction (HCI), the field of 3D hand pose estimation (HPE) has recently got a lot of attention. The use of technological developments, such as deep learning networks has accelerated the development of reliable 3D HPE systems. Therefore, in this paper, a 3D HPE based on Enhanced Global Pyramid Network (EGPNet) is proposed. Initially, feature extraction is done by backbone model of DetNetwork with improved EGPNet. The EGPNet is enhanced by the Smish activation function. After the feature extraction, the HPE is performed based on 3D pose correction network. Additionally, to enhance the estimation performance, Coot optimization algorithm is used to optimize the error between estimated and ground truth hand pose. The effectiveness of the proposed method is experimented on Bharatanatyam, yoga, Kathakali and sign language datasets with different networks in terms of area under the curve, median end-point-error (EPE) and mean EPE. The Coot optimization is also compared with existing optimization algorithms.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Mobile robot control using 3D hand pose estimation
    Hoshino, Kiyoshi
    Kasahara, Takuya
    Igo, Naoki
    Tomida, Motomasa
    Tanimoto, Takanobu
    Mukai, Toshimitsu
    Brossard, Gilles
    Kotani, Hajime
    TENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2011, 8000
  • [22] Improvements in 3D Hand Pose Estimation Using Synthetic Data
    Kanis, Jakub
    Ryumin, Dmitry
    Krnoul, Zdenek
    INTERACTIVE COLLABORATIVE ROBOTICS, ICR 2018, 2018, 11097 : 105 - 115
  • [23] A survey on 3D hand pose estimation: Cameras, methods, and datasets
    Li, Rui
    Liu, Zhenyu
    Tan, Jianrong
    PATTERN RECOGNITION, 2019, 93 : 251 - 272
  • [24] Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction
    Gao, Qing
    Chen, Yongquan
    Ju, Zhaojie
    Liang, Yi
    IEEE SENSORS JOURNAL, 2022, 22 (18) : 17421 - 17430
  • [25] Global hand pose estimation based on pixel voting
    Lin J.
    Li D.
    Chen C.
    Zhao Z.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (19): : 2379 - 2389
  • [26] Lightweight 3D hand pose estimation by cascading CNNs with reinforcement learning
    Chen, Mingqi
    Li, Shaodong
    Shuang, Feng
    Liu, Xi
    Luo, Kai
    He, Wenbo
    PATTERN RECOGNITION LETTERS, 2023, 174 : 137 - 144
  • [27] HandDAGT: A Denoising Adaptive Graph Transformer for 3D Hand Pose Estimation
    Cheng, Wencan
    Kim, Eunji
    Ko, Jong Hwan
    COMPUTER VISION - ECCV 2024, PT LXXXVIII, 2025, 15146 : 35 - 52
  • [28] QMGR-Net: quaternion multi-graph reasoning network for 3D hand pose estimation
    Haomin Ni
    Shengli Xie
    Pingping Xu
    Xiaozhao Fang
    Weijun Sun
    Ribo Fang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 4029 - 4045
  • [29] Differentiable Spatial Regression: A Novel Method for 3D Hand Pose Estimation
    Zhang, Xingyuan
    Zhang, Fuhai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 166 - 176
  • [30] Hand pose estimation based on improved NSRM network
    Yang, Shiqiang
    He, Duo
    Li, Qi
    Wang, Jinhua
    Li, Dexin
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2023, 2023 (01)