Towards Deep Learning based Hand Keypoints Detection for Rapid Sequential Movements from RGB Images

被引:8
|
作者
Gattupalli, Srujana [1 ]
Babu, Ashwin Ramesh [2 ]
Brady, James Robert [2 ]
Makedon, Fillia [2 ]
Athitsos, Vassilis [1 ]
机构
[1] Univ Texas Arlington, Vis Learning Min Lab, Arlington, TX 76019 USA
[2] Univ Texas Arlington, Heracleia Human Ctr Comp Lab, Arlington, TX 76019 USA
来源
11TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2018) | 2018年
基金
美国国家科学基金会;
关键词
hand keypoints detection; deep learning; computer vision; convolutional neural networks; hand pose recognition; cognitive behavior assessment; gesture recognition;
D O I
10.1145/3197768.3201538
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Hand keypoints detection and pose estimation has numerous applications in computer vision, but it is still an unsolved problem in many aspects. An application of hand keypoints detection is in performing cognitive assessments of a subject by observing the performance of that subject in physical tasks involving rapid finger motion. As a part of this work, we introduce a novel hand keypoints benchmark dataset that consists of hand gestures recorded specifically for cognitive behavior monitoring. We explore the state of the art methods in hand keypoint detection and we provide quantitative evaluations for the performance of these methods on our dataset. In future, these results and our dataset can serve as a useful benchmark for hand keypoint recognition for rapid finger movements.
引用
收藏
页码:31 / 37
页数:7
相关论文
共 50 条
  • [1] Deep network based 3D hand keypoints prediction from single RGB images
    Wang, Jialong
    Sang, Nong
    PATTERN RECOGNITION AND TRACKING XXX, 2019, 10995
  • [2] Hand Pose Estimation from RGB Images Based on Deep Learning: A Survey
    Liu, Yang
    Jiang, Jie
    Sun, Jiahao
    2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 82 - 89
  • [3] Deep Learning-Based Human Detection Using RGB and IR Images from Drones
    Bae, Seonguk
    Shin, Heejung
    Kim, Hyeongseop
    Park, Minkyu
    Choi, Myong-Yol
    Oh, Hyondong
    INTERNATIONAL JOURNAL OF AERONAUTICAL AND SPACE SCIENCES, 2024, 25 (01) : 164 - 175
  • [4] Deep Learning-Based Human Detection Using RGB and IR Images from Drones
    Seonguk Bae
    Heejung Shin
    Hyeongseop Kim
    Minkyu Park
    Myong-Yol Choi
    Hyondong Oh
    International Journal of Aeronautical and Space Sciences, 2024, 25 : 164 - 175
  • [5] Dynamic Detection and Recognition of Objects Based on Sequential RGB Images
    Dong, Shuai
    Yang, Zhihua
    Li, Wensheng
    Zou, Kun
    FUTURE INTERNET, 2021, 13 (07)
  • [6] Flame Temperature Detection and Estimation Model Based on Deep Learning and Ordinary RGB Images
    Qiao Shizhan
    Yan Qilong
    Huang Dongfang
    Liu Yifei
    PROCEEDINGS OF 2021 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS '21), 2021,
  • [7] Fusion of thermal and RGB images for automated deep learning based crack detection in civil infrastructure
    Quincy G. Alexander
    Vedhus Hoskere
    Yasutaka Narazaki
    Andrew Maxwell
    Billie F. Spencer
    AI in Civil Engineering, 1 (1):
  • [8] Deep Learning based Melanoma Detection from Dermoscopic Images
    Berkay, Mustafa
    Mergen, Ezgi Hazal
    Binici, Rifki Can
    Bayhan, Yasemin
    Gungor, Ayca
    Okur, Erdem
    Unay, Devrim
    Turkan, Mehmet
    2019 SCIENTIFIC MEETING ON ELECTRICAL-ELECTRONICS & BIOMEDICAL ENGINEERING AND COMPUTER SCIENCE (EBBT), 2019,
  • [9] Deep Learning-Based Pedestrian Detection Using RGB Images and Sparse LiDAR Point Clouds
    Xu, Haoran
    Huang, Shuo
    Yang, Yixin
    Chen, Xiaodao
    Hu, Shiyan
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (05) : 7149 - 7161
  • [10] An improved deep learning approach for detection of maize tassels using UAV-based RGB images
    Chen, Jiahao
    Fu, Yongshuo
    Guo, Yahui
    Xu, Yue
    Zhang, Xuan
    Hao, Fanghua
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 130