Coot optimization based Enhanced Global Pyramid Network for 3D hand pose estimation

被引:0
|
作者
Malavath, Pallavi [1 ]
Devarakonda, Nagaraju [1 ]
机构
[1] VIT AP Univ AP Univ, Sch Comp Sci & Engn, Amaravati, India
来源
MACHINE LEARNING-SCIENCE AND TECHNOLOGY | 2022年 / 3卷 / 04期
关键词
hand pose estimation; Enhanced Global Pyramid Network; DetNet; pose correction network; Coot optimization and sign language;
D O I
10.1088/2632-2153/ac9fa5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to its importance in various applications that need human-computer interaction (HCI), the field of 3D hand pose estimation (HPE) has recently got a lot of attention. The use of technological developments, such as deep learning networks has accelerated the development of reliable 3D HPE systems. Therefore, in this paper, a 3D HPE based on Enhanced Global Pyramid Network (EGPNet) is proposed. Initially, feature extraction is done by backbone model of DetNetwork with improved EGPNet. The EGPNet is enhanced by the Smish activation function. After the feature extraction, the HPE is performed based on 3D pose correction network. Additionally, to enhance the estimation performance, Coot optimization algorithm is used to optimize the error between estimated and ground truth hand pose. The effectiveness of the proposed method is experimented on Bharatanatyam, yoga, Kathakali and sign language datasets with different networks in terms of area under the curve, median end-point-error (EPE) and mean EPE. The Coot optimization is also compared with existing optimization algorithms.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] LGCANet: lightweight hand pose estimation network based on HRNet
    Pan, Xiaoying
    Li, Shoukun
    Wang, Hao
    Wang, Beibei
    Wang, Haoyi
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (13) : 19351 - 19373
  • [42] ASCS-Reinforcement Learning: A Cascaded Framework for Accurate 3D Hand Pose Estimation
    Chen, Mingqi
    Shuang, Feng
    Li, Shaodong
    Liu, Xi
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 335 - 342
  • [43] NETWORKS EFFECTIVELY UTILIZING 2D SPATIAL INFORMATION FOR ACCURATE 3D HAND POSE ESTIMATION
    Liu, Baoen
    Huang, Shiliang
    Ye, Zhongfu
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 574 - 578
  • [44] A Synchronized Multi-view System for Real-Time 3D Hand Pose Estimation
    Yu, Zhipeng
    Wang, Yangang
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT III, 2022, 13606 : 588 - 593
  • [45] Graph-Based CNNs With Self-Supervised Module for 3D Hand Pose Estimation From Monocular RGB
    Guo, Shaoxiang
    Rigall, Eric
    Qi, Lin
    Dong, Xinghui
    Li, Haiyan
    Dong, Junyu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (04) : 1514 - 1525
  • [46] Real-time monitoring of manual acupuncture stimulation parameters based on domain adaptive 3D hand pose estimation
    Xu, Liuliu
    Gong, Haifan
    Zhong, Yun
    Wang, Fan
    Wang, Shouxin
    Lu, Lu
    Ding, Jinru
    Zhao, Chen
    Tang, Wenchao
    Xu, Jie
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 83
  • [47] Learning a Deep Predictive Coding Network for a Semi-Supervised 3D-Hand Pose Estimation
    Jamal Banzi
    Isack Bulugu
    Zhongfu Ye
    IEEE/CAA Journal of Automatica Sinica, 2020, 7 (05) : 1371 - 1379
  • [48] Learning a Deep Predictive Coding Network for a Semi-Supervised 3D-Hand Pose Estimation
    Banzi, Jamal
    Bulugu, Isack
    Huang, Shiliang
    Ye, Zhongfu
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (05) : 1371 - 1379
  • [49] Cascading CNNs with S-DQN: A Parameter-Parsimonious Strategy for 3D Hand Pose Estimation
    Chen, Mingqi
    Li, Shaodong
    Shuang, Feng
    Luo, Kai
    MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 358 - 369
  • [50] SPMHand: Segmentation-Guided Progressive Multi-Path 3D Hand Pose and Shape Estimation
    Lu, Haofan
    Gou, Shuiping
    Li, Ruimin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6822 - 6833