Coot optimization based Enhanced Global Pyramid Network for 3D hand pose estimation

被引:0
|
作者
Malavath, Pallavi [1 ]
Devarakonda, Nagaraju [1 ]
机构
[1] VIT AP Univ AP Univ, Sch Comp Sci & Engn, Amaravati, India
来源
MACHINE LEARNING-SCIENCE AND TECHNOLOGY | 2022年 / 3卷 / 04期
关键词
hand pose estimation; Enhanced Global Pyramid Network; DetNet; pose correction network; Coot optimization and sign language;
D O I
10.1088/2632-2153/ac9fa5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to its importance in various applications that need human-computer interaction (HCI), the field of 3D hand pose estimation (HPE) has recently got a lot of attention. The use of technological developments, such as deep learning networks has accelerated the development of reliable 3D HPE systems. Therefore, in this paper, a 3D HPE based on Enhanced Global Pyramid Network (EGPNet) is proposed. Initially, feature extraction is done by backbone model of DetNetwork with improved EGPNet. The EGPNet is enhanced by the Smish activation function. After the feature extraction, the HPE is performed based on 3D pose correction network. Additionally, to enhance the estimation performance, Coot optimization algorithm is used to optimize the error between estimated and ground truth hand pose. The effectiveness of the proposed method is experimented on Bharatanatyam, yoga, Kathakali and sign language datasets with different networks in terms of area under the curve, median end-point-error (EPE) and mean EPE. The Coot optimization is also compared with existing optimization algorithms.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] CASCADED POINT NETWORK FOR 3D HAND POSE ESTIMATION
    Dou, Yikun
    Wang, Xuguang
    Zhu, Yuying
    Deng, Xiaoming
    Ma, Cuixia
    Chang, Liang
    Wang, Hongan
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1982 - 1986
  • [2] Monocular 3D hand pose estimation based on high-resolution network
    Shengling Li
    Wanjuan Su
    Guansheng Luo
    Jinshan Tian
    Yifei Han
    Liman Liu
    Wenbing Tao
    Advances in Continuous and Discrete Models, 2025 (1):
  • [3] 3D Capsule Hand Pose Estimation Network Based on Structural Relationship Information
    Wu, Yiqi
    Ma, Shichao
    Zhang, Dejun
    Sun, Jun
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 14
  • [4] Hand Pose Estimation Based on 3D Residual Network with Data Padding and Skeleton Steadying
    Ting, Pai-Wen
    Chou, En-Te
    Tang, Ya-Hui
    Fu, Li-Chen
    COMPUTER VISION - ACCV 2018, PT V, 2019, 11365 : 293 - 307
  • [5] Attention-Based Pose Sequence Machine for 3D Hand Pose Estimation
    Guo, Fangtai
    He, Zaixing
    Zhang, Shuyou
    Zhao, Xinyue
    Tan, Jianrong
    IEEE ACCESS, 2020, 8 : 18258 - 18269
  • [6] SARN: Shifted Attention Regression Network for 3D Hand Pose Estimation
    Zhu, Chenfei
    Hu, Boce
    Chen, Jiawei
    Ai, Xupeng
    Agrawal, Sunil K. K.
    BIOENGINEERING-BASEL, 2023, 10 (02):
  • [7] Accurate 3D hand pose estimation network utilizing joints information
    Zhang, Xiongquan
    Huang, Shiliang
    Ye, Zhongfu
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 90
  • [8] 3D Hand Pose Estimation with Neural Networks
    Antonio Serra, Jose
    Garcia-Rodriguez, Jose
    Orts-Escolano, Sergio
    Manuel Garcia-Chamizo, Juan
    Angelopoulou, Anastassia
    Psarrou, Alexandra
    Mentzelopoulos, Markos
    Montoyo-Bojo, Javier
    Dominguez, Enrique
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, PT II, 2013, 7903 : 504 - +
  • [9] HBE: Hand Branch Ensemble Network for Real-Time 3D Hand Pose Estimation
    Zhou, Yidan
    Lu, Jian
    Du, Kuo
    Lin, Xiangbo
    Sun, Yi
    Ma, Xiaohong
    COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 521 - 536
  • [10] Learning a deep network with spherical part model for 3D hand pose estimation
    Chen, Tzu-Yang
    Ting, Pai-Wen
    Wu, Min-Yu
    Fu, Li-Chen
    PATTERN RECOGNITION, 2018, 80 : 1 - 20